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I.  INTRODUCTION  AND  BACKGROUND 


A. \ ^Introduction 

This  is  the  final  report  of  a one-year  project  (Contract 
No.  DAAG39-77-C-0095  Department  of  the  Army,  Harry  Diamond 
Laboratories),  undertaken  in  June  1977,  to  develop  improved 
forecasting  procedures  for  Order  Ship  Times  (OSTs)  and  updating 
procedures  for  inventory  control  requisitioning  objectives 
(ROs)  for  direct  support  units  (DSUs)  of  the  Army's  Direct 
Support  Unit  Standard  Supply  System  (DS4) . The  study  has  con- 
sisted of  a review  of  the  current  status  and  practices  relating 
to  these  two  aspects  of  inventory  control,  the  development 
of  alternative  candidate  procedures  for  OST  forecasting  and 
RO  updating, the  evaluation  of  these  alternatives  utilizing 
actual  OST  and  demand  data  from  sample  DSUs,  and  the  development 
of  recommendations  for  OST  forecasting  and  RO  updating.  The 
report  presents  the  summary  and  conclusions  in  Chapter  II,  a 
detailed  discussion  of  the  methodology  used  in  the  study  in 
Chapter  IIIr  the  detailed  results  for  sample  DSUs  in  Chapters 
IV  and  V,  the  analysis  of  results  in  Chapter  VI,  implementation 
considerations  in  Chapter  VII,  and  the  detailed  analysis  of 
RO-updating  procedures  in  Chapter  VIII.  Appendices  giving  tech- 
nical results  and  detailed  data  are  also  included. 
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B.  OSTs  In  The  Army  Logistics  Systems 

This  section  briefly  discusses  the  concept  of  the  Order  Ship 
Time  (OST) , the  importance  of  obtaining  accurate  forecasts  of  the  OST 
when  requisitioning  replenishments  for  the  DSUs  of  the  Direct  Support 
System, currently  prescribed  techniques  for  estimating  OSTs,  and  recent 
studies  on  improved  OST  forecasting  techniques  and  the  benefits  ex- 
pected from  such  improvements. 

1,  Order  Ship  Time  Defined 

The  Order  Ship  Time  (OST)  is  the  actual  time  elapsing  in  days 
between  the  initiation  date  of  stock  replenishment  action  for  a speci- 
fic activity  and  the  date  of  recording  of  the  receipt  by  that  activity 
of  the  material  on  the  requisitioner ' s inventory  records.  — The 
U.S.  Army  DARCOM  Logistic  Control  Activity  in  San  Francisco  maintains 
a computerized  tracking  system  for  Army  supply  and  transportation  actions 
called  the  Logistics  Intelligence  File  (LIF) . Each  segment  of  the  OST 
for  a requisition  is  recorded  in  this  file.  From  this  information, 
monthly  Direct  Support  System  Performance  Evaluations  are  issued.  These 
show  the  average  pipeline  segment  processing  time  for  all  segments  of 
the  OST  for  re-supplying  Army  activities  throughout  the  world.  Break- 
downs are  given  by  requisition  priority  classes  and  by  surface  and  air 
replenishment. 

2.  Importance  of  Accurate  OST  Forecasts 

The  timing  of  replenishment  requisitions  depends  on  the  estimated 
OST  for  the  particular  path  the  requisition  must  follow.  The  requi- 
sition must  be  placed  early  enough  so  that  during  the  time  required 


— DOA  AR  710-2,  C 4,  Inventory  Management,  Paragraph  3-28-b,  May,  1977. 
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for  its  processing  and  the  replenishment  quantity  to  arrive,  there 
will  be  sufficient  inventory  still  at  the  requisitioning  point  to 
prevent  excessive  stockouts.  The  inventory  level  at  which  a requi- 
sition should  be  placed  is  the  Reorder  Point  (ROP) , given  by: 


ROP  = Average  Demand  During  OST  + Safety  Stock 

The  Safety  Stock  may  be  decomposed  into  a Safety  Factor  and  the 
Standard  Deviation  of  demand  during  the  forecasted  OST; 

e - . , re  c ^ -n  ^ \ v ( Standard  Deviation  of\  ,,, 

Safety  Stock  - (Safety  Factor)  X (DMand  ^ Fo„caat  0ST ) «) 

Safety  Stock  is  required  because  the  actual  OSTs  vary  un- 
predictably  around  the  forecasted  value.  If  the  ROP  were  set  equal 
to  only  the  average  demand  during  the  OST,  stockout  conditions  would 
be  expected  on  about  half  the  requisitions,  which  is  too  frequent. 

Hence  a Safety  Stock  margin  is  added  to  the  expected  demand  during  the 
OST. 


From  Eq.(l),  a Safety  Stock  based  on  a poor  forecast  of  the  OST  will 
result  in  an  actual  Safety  Factor  considerably  different  from  the 
desired  Safety  Factor,  and  hence  a Demand  Satisfaction  percentage  con- 
siderably different  from  the  desired  level. 

Accurate  forecasts  of  OSTs  are  necessary  not  only  to  control 
Demand  Satisfaction  at  the  desired  level,  but  also  to  achieve  this 
level  at  a low  inventory  investment.  This  may  be  seen  from  the 
following  relations: 

Average  Inventory  Level  = 0.5  Order  Quantity  + Safety  Stock 


or 


■ °-5  0rder  Q“antlty  + (S)  X ( Deviation) 
Safety  Factor  ■ «> 


The  Standard  Deviation  depends  on  how  accurately  the  OST  and  the 
demand  rate  during  the  OST  can  be  forecasted.  An  accurate  forecasting 
technique  for  OSTs  will  reduce  the  Standard  Deviation,  thus  achieving 
a given  Safety  Factor  and  Demand  Satisfaction  level  at  a lower  required 
inventory  investment. 
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3.  Forecasting  Methods  for  OSTs 

With  hundreds  of  OST  forecasts  required  almost  continuously 
by  Army  units  such  as  DSUs,  it  is  inevitable  that  a detailed  and 
sophisticated  forecasting  technique  cannot  be  used  in  each  case. 
Instead,  a technique  based  on  past  OST  history,  modified  by  any 
new  intelligence  that  can  practicably  be  incorporated  into  the 
forecast,  must  be  used. 

Prescribed  techniques  for  estimating  OSTs  have  been  as 
follows : 

a.  In  the  first  edition  of  the  Army  Inventory  Management 
Manual  (AR  710-2,  October,  1971),  OSTs  for  each  material 
category  in  the  Authorized  Stock  List  (ASL)  were  calculated 
as  the  average  elapsed  time  of  the  most  recent  six  replenish- 
ment transactions  for  a representative  5 percent  of  ASL  items. 

b.  In  the  latest  version  (Change  4,  May,  1977)  of  AR  710-2, 

Direct  Support  Units  calculate  OSTs  quarterly  as  a random 
sample  of  10  percent  of  all  requisitions  for  ASL  items 
completed  during  the  quarter  (excluding  high  priority  re- 
quisitions and  those  affected  by  delays),  without  regard 
to  materiel  category. 

c.  The  currently  proposed  method  of  forecasting  OSTs  in  the 
Direct  Support  Unit  Standard  Supply  System  (DS4)  is  to  use 
individual  item  OSTs,  based  on  the  arithmetic  average  of 
the  most  recent  six  replenishments,  excluding  high  priority 
requisitions.  The  DSS  Standard  OST,  applicable  to  the  DSU's 
geographical  location,  may  be  used  until  sufficient  OSTs 
can  be  compiled  and  the  average  OST  computed  for  an  item. 


The  average  OST  recorded  will  be  automatically  com- 
pared to  the  OST  of  each  shipment  of  like  items  received. 

Those  OSTs  beyond  an  allowable  percent  of  variation  will 
be  identified  as  candidates  for  exclusion  in  the  OST 
computations . 

Shortcomings  of  the  above  techniques  have  been  recognized, 
and  several  studies  have  been  conducted  on  alternative  forecasting 
techniques  for  OSTs.  Recently  the  Logistics  Control  Activity  at 
the  Presidio  analyzed  the  frequency  distribution  of  OSTs  and  con- 
cluded that  use  of  an  average  OST  value  was  undesirable  because  of 

2 

the  undue  influence  of  outliers.  — Instead,  it  was  recommended 
that  for  DSS  inventory  management,  the  median  OST  value  rather  than 
the  average  value  be  used,  and  that  thereby  overs tockage  at  the  DSU 
would  be  minimized  in  the  long  run. 

The  DRC  Inventory  Research  Office  in  Philadelphia  has  com- 
pleted a study  on  the  forecasting  of  OSTs  for  CONUS  depots  and  found 
that  OST  forecasts  by  groups  of  items  were  more  accurate  than  for 

individual  items,  although  in  some  cases  a weighted  average  of  the 

3 

group  and  individual  item  OST  forecast  was  desirable.  — 

Further  investigation  of  using  individual  item  OSTs  versus 

• 4 

group  OSTs  has  been  carried  out  in  the  comprehensive  RIMSTOP  studies  — . 

It  was  found  that  there  was  little  difference  in  results  between  the 
two  methods  of  forecasting  OSTs.  However,  the  specific  question  of  how  to 
improve  the  forecast  of  individual  item  OSTs  was  not  addressed. 

The  above  summary  of  prescriptions  and  studies  of  OST  estimation 
makes  clear  the  need  for  this  present  study  on  specific  comparisons  of 
OST  forecasting  techniques  and  the  effect  of  forecasting  accuracy  on 
inventory  system  performance. 


2 

— U.S.  Army  DARCOM  Logistic  Control  Activity,  DSS  Distribution  Analysis 
Study  Program,  FY77. 

3 

— Kruse,  W.  K. , Forecasting  Order  & Ship  Time  for  CONUS  Depots,  DRC 
Inventory  Research  Office  Report  No.  238  (Phase  1)),  June  1977. 

4 

— Joint  DoD  Retail  Inventory  Management  and  Stockage Policy  (RIMSTOP) 
Working  Group  Report,  Vol.  Ill,  Part  2,  Pages  IV-22  to  IV-28 , Sept . 1976 . 
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II  SUMMARY  AND  CONCLUSIONS 


The  two  basic  objectives  of  the  present  study  were  1)  to  develop 
improved  OST  forecasting  techniques  and  2)  to  develop  improved  ROP  and 
RO  updating  procedures.  The  first  phase  of  the  effort  was  concentrated  on 
developing  the  OST  forecasting  techniques,  then  the  question  of  ROP/RO 
updating  was  analyzed.  In  this  way,  it  was  possible  to  consider  a spe- 
cific OST-forecasting  model  when  carrying  out  this  latter  analysis. 

A.  OST-Forecast  Models 

A number  of  alternative  candidate  OST-forecast  models  were  developed 
for  evaluation  during  the  study.  These  included  the  mean  (OSTN) , median 
(OSTM) , and  mode  (OSTMO)  of  a sample  of  historical  OST  observations,  the 
mean  of  the  OST  observations  occurring  in  a specified  past  time  period 
(OSTT),  the  mean  of  the  (variable)  number  of  OST  observations  necessary 
to  produce  a specific  forecast  accuracy  of  the  OST  mean  (OSTNE) , adaptive 
single  exponential  smoothing  (OSTES),  adaptive  double  exponential  smoothing 
(OSTDES),  and  least-squares  regression  (trend)  line  (OSTR).  Also,  periodic 
update  versions  of  OSTN  and  OSTES  were  developed  (OSTNP  and  OSTESP) . These 
models  are  specified  in  greater  detail  in  Section  III. A. 

B.  OST  Data  Base 

In  order  to  evaluate  the  candidate  OST-forecast  models,  two  sample 
DSUs  were  selected.  These  were  both  Divisional  DSUs,  one  in  CONUS  and  one 
in  Europe: 

CONUS  Divisional  DSU:  704th  Maintenance  Bn. 

EUROPE  " " 703rd  Maintenance  Bn. 

These  two  large  DSUs  have  a wide  variety  of  types  of  items  and  materiel 
classes,  adequate  to  provide  a good  basis  for  evaluation  of  the  alterna- 
tive forecasting  models.  The  selecting  of  the  European  DSU  made  it  possible 
to  evaluate  the  performance  of  the  models  on  ALOC-requisition  data,  a unique 
feature  for  overseas  DSUs. 


6 


The  basic  OST  data  were  obtained  from  :he  US  DARCOM  LCA  Logistic 
Intelligence  File,  both  active  and  retired.  This  resulted  in  about  a 
one-year  period  of  OST-data  from  about  mid  1976  to  mid  1977.  For  each 
sample  DSU,  requisitions  were  grouped  by  item  (NSN)  and  those  items  se- 
lected that  had  at  least  6 computable  (completed)  requisitions.  Only  ASL 
routine  priority  requisitions  were  selected,  and  CONUS  requisitions  having 
OSTs  greater  than  100  days  and  European  requisitions  having  OSTs  greater 
than  150  days  were  eliminated.  This  provided  a comprehensive  data  base  of 
OSTs  for  both  the  domestic  and  overseas  DSUs. 

C.  OST  Item  Groups 

It  was  found  that  the  principal  factor  for  the  classification  of  oils 
into  homogeneous  groups  was  the  cognizant  National  Inventory  Control  Point 
for  supplying  the  items.  This  is  indicated  in  the  LIF  by  the  Routing  Indi- 
cator Code  (RIC) . The  OST  characteristics  showed  considerable  variation 
for  the  various  RICs.  Some  RICs  however,  showed  no  statistically  signifi- 
cant differences  among  themselves.  A "clustering"  technique  was  developed 
to  collect  such  RICs  into  homogeneous  RIC-groups  which  then  formed  the  OST 
item-groups  for  use  in  generating  OST  forecasts  for  items  within  the  group. 
This  procedure  is  discussed  in  more  detail  in  Section  III.D. 

D.  Item/Group  OST-Forecasting  Classification 

The  formation  of  OST  item-groups  does  not  necessarily  mean  that  all 
items  within  the  group  should  be  forecasted  by  using  only  group  OSTs.  It 
was  found  that  within  an  item-group  some  items  had  statistically  significant 
different  OST  characteristics  than  those  of  the  whole  group.  These  items 
could  be  better  forecasted  by  using  only  their  own  historical  OSTs  or  some 
kind  of  combination  of  the  group  and  item  OST  forecasts.  Based  on  the 
number  of  OST  observations  in  the  data  base  for  the  item-group,  their  mean 
and  standard  deviation  and  these  same  quantities  for  an  individual  item,  it 
was  possible  to  develop  an  expression,  for  the  expected  item  OST  as  a probabil- 
ity weighting  of  the  group  and  item  mean  OSTs.  This  was  compared  to  other 
weighting  schemes  proposed  in  the  past  and  with  a scheme  developed  in  this 
study  for  classifying  an  item  as  either  group-forecast  or  item-forecast. 
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As  a result  of  this  analysis  (see  Section  III.D)  it  was  concluded  that 
item/group-forecast  classification  was  essentially  equivalent  to  the 
"expected-value"  procedure,  whereas  the  other  weighting  scheme  resulted 
in  significant  deviations  from  this  procedure.  It  was  concluded  that  the 
item/group-forecast  classification  procedure  provides  a simple  and  effective 
means  of  determining  whether  to  utilize  an  item  or  group  forecast  for  a 
particular  item. 

E.  Forecast  Error  Evaluation  of  OST-Forecasting  Models 

A first  screening  of  the  candidate  OST-forecasting  models  was  based 
on  measures  of  total  error  of  the  OST  forecasts.  This  measure  was  the 
root-mean -square  forecast  error,  RMSE.  This  measure  does  not  take  into 
account  explicitly  the  effect  of  forecast  error  on  the  performance  of  the 
inventory  control  system  in  which  these  forecasts  are  used,  but  is  a 
strictly  statistical  measure  that  would  be  expected  to  be  larger  for  gener- 
ally poor  forecasting  procedures  and  smaller  for  better  procedures.  In 
order  to  evaluate  OST-forecast  model  performance  as  indicated  by  this 
measure  the  models  were  applied  by  means  of  a simulator/evaluator  to  random 
samples  of  OSTs  selected  from  the  principal  RIC-groups  of  the  2 sample  DSUs. 
Based  on  the  RMSE  values  obtained  in  these  simulations,  it  was  concluded 
that  for  both  DSUs  the  five  models  (not  in  priority  sequence) : 

OSTN 

OSTM 

OSTT 

OSTNE 

OSTES 

were  the  most  promising  for  further  evaluation  with  respect  to  inventory 
effects  of  OST  forecast  error.  These  analyses  are  discussed  in  greater 
detail  in  Section  III.E  below. 

F.  Evaluation  of  Inventory  Effects  of  OST-Forecast  Error 

To  evaluate  the  inventory  effects  of  OST-forecast  error  it  was  ne- 
cessary to  select  item  samples  for  each  DSU  and  determine  the  individual 
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item  and  overall  sample  inventory  effects  of  the  five  above  (screened) 
candidate  OST-forecast  models.  These  effects  depended  on  the  forecast 
error  statistics  for  the  alternative  models  and  the  item  parameters 
(inventory  holding  cost  rate,  fixed  requisition  order  cost,  and  safety 
stock  coverage  period). 

Inventory  effects  of  the  alternative  OST-forecast  models  were  measured 
in  two  ways:  1)  comparison  of  the  resulting  average  inventory  requirement 
and  demand  satisfaction  rate  with  those  resulting  from  a perfect  OST- 
forecast,  and  2)  comparison  of  a single  measure,  a normalized  increase 
in  inventory  requirement  over  that  for  a perfect  forecast.  The  technique 
used  in  this  study  for  obtaining  this  normalized  single  performance  measure 
of  the  inventory  effect  of  a particular  model  was  to  adjust  the  value  of  the 
safety  stock  coverage  period  until  the  demand'  satisfaction  rate  for  the 
model  was  equal  to  that  for  a perfect  forecast,  then  determine  the  required 
increase  in  inventory  necessary  to  accomplish  this.  This  was  done  for 
individual  items  of  the  samples  and  for  the  sample  as  a whole,  for  each 
sample  DSU  (see  Section  IV. D and  V.D). 

It  was  found  that  composite  ranking  for  individual  items  in  the  samples 
and  for  the  samples  as  a whole,  were  consistent  with  each  other  and  for 
both  DSUs.  This  ranking  was: 


OST- 

Forecasting  Model 

Rank 

CONUS  DSU 

EUROPEAN  DSU 

1 

OSTES 

OSTES 

2 

OSTNE 

OSTN 

3 

OSTN 

OSTT 

4 

OSTT 

OSTM 

5 

OSTM 

OSTNE 

Only  OSTNE  shows  a significantly  different  sequencing.  Although  it  was 
possible  to  rank  the  OST-forecast  models,  the  differences  of  inventory 
effects  among  the  models  was  not  found  to  be  very  great,  of  the  order  of 
1%  to  2%  of  the  perfect  forecast  inventory  requirement.  This  meant  that 
implementation  aspects  of  introducing  the  models  into  the  DS4  system  are 
important  in  the  final  selection  of  a recommended  model. 
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G.  Improved  OST-Forecast  Error  Measure 


In  the  present  study  a two-staged  evaluation  procedure  was  used. 

The  candidate  OST-forecast  models  were  first  screened  by  using  general 
statistical  measure  of  forecast  error  from  actual  OSTs  (RMSE)  and  from 
OST  mean  (RMSE').  Another  such  statistical  measure  of  error  frequency  used 
is  the  Mean  Absolute  Deviation  (MAD)  which  was  calculated  in  the  present 
study  but  not  found  to  be  a consistent  or  useful  measure.  Then  the  screened 
models  were  subjected  to  a more  refined  analysis  based  on  inventory  effects. 
It  would  be  very  desirable  to  have  a general  statistical  measure  of  OST 
forecast  error  that  would  correlate  closely  with  the  ultimate  resulting 
inventory  performance. 

It  was  found  (see  Section  VII)  that  the  effect  of  forecast  error  on 
inventory  performance  may  be  decomposed  into  the  effect  of  forecast  bias 
(mean  forecast  error)  and  standard  deviation  (or  statistical  variance)  of 
forecast  error.  The  effect  of  forecast  bias  was  found  to  be  very  slight 
since  its  effects  can  be  almost  completely  eliminated  by  a compensating 
adjustment  of  the  safety  stock  coverage  period.  The  inventory  effect 
performance  of  the  models  correlated  almost  perfectly,  for  both  indi/idual 
items  and  the  entire  item  samples  with  the  standard  deviation  (or  variance) 
of  OST  forecast  error. 

Thus  it  was  concluded  that  the  use  of  the  statistical  variance  as  a 
measure  of  OST-forecast  error  provides  a reliable  indicator  of 
the  inventory  effects  performance  of  an  OST-forecasting  pro- 
cedure. This  makes  possible  a much  simpler  evaluation  of  alternative 
such  procedures,  based  on  the  relatively  simple  forecast  error  evaluation 
techniques  used  in  the  initial  screening  of  models  in  the  present  study. 

H.  Implementation  Considerations 

As  indicated  in  Section  F above,  the  final  selection  of  a recom- 
mended OST  forecasting  model  depends  on  the  relative  ease  with  which  they 
may  be  implemented  and  utilized  in  the  DSS  system.  It  was  found  (see 
Section  VII. A-E)  that  all  models  except  OSTES  would  require  relatively  large 
(and  sometimes  variable)  OST  data  base  storage  requirements.  The  model 
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OSTES,  on  the  other  hand,  in  addition  to  showing  the  (slightly)  best 
overall  performance  requires  a data  base  of  only  3 elements  for  carrying 
out  the  OST  forecasting  procedures.  Thus  it  is  concluded  that  the  OSTES 
OST-forecast  model  is  clearly  to  be  recommended  among  the  alternatives 
considered  in  the  present  study. 

I.  Reorder  Point/Requisitioning  Objective  Updating 

It  was  found  (see  Section  VIII)  that  the  primary  inventory  effects 
of  alternative  updating  procedures  relate  to  the  reorder  point  (ROP)  rather 
than  to  the  requisitioning  objective  (RO) . Current  Army  policy  is  to  up- 
date both  ROP  and  RO  at  the  time  a requisition  for  an  item  is  placed  - that 
is,  when  the  inventory  position  of  the  items  falls  to  the  ROP  calculated 
at  the  time  of  the  previous  requisition.  This  value  of  the  ROP  may  be  quite 
different  from  the  most  appropriate  value,  the  one  recalculated  for  the 
present  requisition.  This  means  that  this  requisition  is  placed  when  the 
inventory  position  is  too  high  or  too  low,  both  cases  having  undesirable 
inventory  or  service  effects.  The  RO  calculated  at  this  time  is  the  appropri- 
ate value  to  use  in  determining  the  requisition  order  quantity  and  there  is 
no  necessity  to  update  the  RO  itself  during  the  interim  between  requisitions, 
as  is  more  necessary  for  the  ROP  as  discussed  above. 

The  formula  for  updating  the  ROP  is  very  simple  and  in  a computerized 
system  there  is  essentially  no  cost,  time,  or  effort  in  updating  this  value 
at  the  time  either  the  demand  forecast  or  OST  forecast  (the  two  forecasts 
on  which  the  ROP  and  RO  depend)  is  updated.  Consequently,  it  is  recommended 
that  the  ROP  be  updated  whenever  the  demand  or  OST  forecasts  are  updated, 
and  the  RO  be  updated  at  the  time  a requisition  is  triggered  by  the  ROP. 

In  this  way,  the  requisition  will  be  triggered  at  the  most  appropriate  in- 
ventory level,  and  the  RO  is  recalculated  only  when  it  is  necessary  for  de- 
termining the  requisition  order  quantity.  However,  with  essentially  no 
additional  effort  the  RO  could  be  updated  at  the  same  time  as  the  ROP  so 
that  both  of  these  control  levels  could  be  maintained  at  their  most  ap- 
propriate current  values  at  all  times,  as  might  be  desirable  if  the  ROP 
and  RO  are  included  on  any  inventory  control  reports  or  listings  that  may 
be  generated  in  the  system. 
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Summary  of  Recommendations 


1.  Utilize  RIC-Groups  based  on  OST  data  in  the  US  DARCOM  LCA/LIF 
to  define  OST  item  groups. 

2.  Apply  the  item/group-forecast  criteria  developed  in  this  study 
to  classify  items  as  item-forecast  or  group-forecast. 

3.  Utilize  the  OSTES  OST-forecasting  model  for  generating  item 
and  item-group  OST  forecasts. 

4.  Update  ROP  whenever  the  demand  or  OST  forecasts  are  updated,  and 
update  the  RO  whenever  a requisition  is  triggered  , or  simultaneously 
with  the  ROP  update-whichever  is  most  desirable  from  an  implement- 
ation standpoint. 

5.  Utilize  the  statistical  standard  deviation  (or  variance)  of  OST- 
forecast  error  as  a measure  of  the  inventory  effects  performance 
in  any  further  evaluations  of  OST-forecasting  models. 
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III.  DETAILED  METHODOLOGY 


A.  Forecast  Models 

Ten  basic  alternative  OST  forecasting  procedures  (models)  were 
developed  for  application  to  any  time  series  of  OST  observations: 

OSTN:  The  average  of  the  last  N OST  observations 

OSTM:  The  median  of  the  last  N observations 

OSTMO:  The  mode  of  last  N observations 

OSTT:  The  average  of  the  OST  observations  occurring  in  the 

past  time  period  T.  This  procedure  includes  both  upper 
and  lower  limits  on  the  number  of  observations  to  use  in 
computing  the  OST  forecast.  These  are  determined  by 
specifying  lower  and  upper  limits,  respectively,  on  the 
error  with  which  the  mean  OST  is  estimated  by  the  model. 

These  errors,  together  with  the  statistics  of  forecast  errors 
generated  by  successive  forecasts,  are  used  to  calculate 
the  upper  and  lower  limits  on  the  number  of  required  OST 
observations.  If  the  number  of  observations  falling  in 
the  previous  time  period  T lies  between  these  limits  then 
this  number  of  OSTs  is  taken  to  compute  the  average. 

Otherwise  the  upper  or  lower  limit  number  of  OST  ob- 
servations is  taken. 

OSTNE:  The  average  of  the  number  of  past  OST  observations 

necessary  to  give  a specified  error  (eg. , 5%  or  10%) 
in  the  forecast  of  the  OST  mean. 

OSTES:  Simple  exponential  smoothing  of  successive  OST  obser- 
vations, with  the  smoothing  constant  automatically  cal- 
culated to  give  a specified  error  in  the  forecast  of 
the  OST  mean. 

OSTDES:  Adaptive  double  exponential  smoothing  of  successive  OST 
observations  with  the  smoothing  constant  taken (within 
specified  limits)  equal  to  the  tracking  signal,  and 
corrected  by  a specified  fraction  of  the  trend  and  lag 
correction. 


r 
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OSTR: 


The  one-step-ahead  OST  value  based  on  a linear  least 
squares  regression  of  the  last  specified  number  (N) 
of  OST  observations. 

In  order  to  investigate  the  effect  on  forecast  accuracy  of  updating 
the  OST  forecast  periodically  rather  than  for  each  OST  occurrence,  the 
following  two  models  were  also  developed: 

OSTNP:  For  each  period  of  specified  duration  (eg.,  weekly, 
monthly,  etc.),  the  average  of  the  last  N OST  obser- 
vations. This  is  similar  to  OSTN  except  for  periodic 
rather  than  ad  hoc  updating. 

OSTESP:  For  each  period  of  specified  duration,  the  adaptive 
exponentially  smoothed  value  of  all  OST  observations 
occurring  in  the  preceding  period. 

The  above  OST  forecasting  models  are  described  in  detail  in  the 
following  technical  memoranda  submitted  during  the  project: 

"OST  Forecasting  and  Evaluation  Models",  R.H.  Davis,  8/18/77 

"OST  - MODE  Forecasting  Model",  R.  H.  Davis,  10/17/77 

"Least-squares  Trend  Line  OST- Forecasting  Model",  R.H.  Davis,  10/28/77 

These  memoranda  contain  listings  of  the  FORTRAN  computer  programs 
developed  to  evaluate  the  models.  Updated  listings  are  given  in  Appendix  H. 

B.  OST  Data  Base 

The  basic  source  of  the  OST  data  used  in  the  present  study  was  the 
(active  and  retired)  U.S.Army  DARCOM  Logistics  Control  Activity's 
Logistics  Intelligence  File.  These  files  give  a computer-record  image 
of  the  origin,  intermediate  status,  and  completion  of  each  requisition  for 
stock  replenishment  by  units  (DSUs)  of  the  Army's  Direct  Support  System 
(DSS).  The  data  elements  included  in  these  records  are  given  in  Appendix  A. 
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All  such  records  for  2 sample  DSUs: 

CONUS  - 

704th  Maintenance  Bn.  DODAAC  A5110F 

EUROPE  - 

703rd  Maintenance  Bn.  DODAAC  AK4912/WK4GE4 

were  provided  by  LCA  on  magnetic  tapes  generated  from  the  current 
active  and  retired  LIFs.  These  tapes  were  copied  and  converted  to  (SRI's) 

CDC  - 6400  machine  readable  form  for  further  processing.  During  this 
conversion  the  requisition  records  for  each  sample  DSU  were  sorted  by  ori- 
gination date  sequence  within  NSN  sequence.  OSTs  for  each  completed  re- 
quisition were  then  calculated  as  the  difference  between  the  master  inventory 
record  post  date  MIRP  for  the  first  record  segment  (first  receipt  of 
material  by  the  DSU)  and  the  requisition  origination  date  (RQNDT) . Next, 
only  those  items  (NSNs)  on  the  Authorized  Stock  List  (ASL)  having  at  least 
6 computable  requisitions,  and  requisitions  having  routine  priority  (9-15) 
were  selected  to  provide  the  data  base  of  requisitions  to  be  utilized  in  the 
study.  For  each  such  item  the  mean  (aveage)  and  standard  deviation  of  the 
OSTs  for  all  requisitions  for  that  item  were  calculated,  as  well  as  these 
same  statistics  over  all  requisitions  for  all  items  for  the  DSU.  Histograms 
for  the  set  of  all  requisitions  for  the  DSU  were  also  developed.  In  addition 
to  the  OST  statistics  for  each  item,  the  average  daily  demand  rate  (units/day) 
for  each  Item  was  calculated  by  dividing  the  total  quantity  requisitioned  for 
the  item  by  the  difference  beween  the  earliest  and  latest  requisition  date. 

This  demand  rate  was  extended  by  the  unit  price  (UP)  in  the  record  to  give  a 
$-demand  value  for  each  item.  This  value  is  an  important  item  parameter  in 
selection  of  an  item  sample  for  the  purpose  of  determining  the  inventory  ef- 
fects of  OST  forecast  errors. 

C.  Item  Groups 

Typically,  items  in  the  data  base  have  relatively  few  completed  requisitions. 
The  time  spanned  by  the  data  base  was  about  a year,  so  that  the  number  of 
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requisitions  per  item  ranged  between  6 (the  lower  limit  considered)  and 
15  or  20,  more  usually  between  about  8 and  12.  This  indicates  that  the 
number  of  requisitions  of  an  item  occurring  in  a relevant  historical  time 
period  constitutes  a relatively  small  statistical  sample  for  forecasting 
future  OSTs.  Consequently,  it  is  of  interest  and  importance  to  determine 
groupings  of  items  into  homogeneous  item-groups  having  essentially  the  same 
OST  characteristics,  in  order  to  provide  a better  data  base  for  forecasting 
individual  item  OSTs. 

Data  elements  in  the  LIF  that  might  be  expected  to  be  related  to  the 
selected  OSTs  for  a particular  DSU  are: 


Routing  Identifier  Code 

(RIC) 

ALOC  Indicators 

(ALOC) 

Shipping  Depot 

(DEPOT) 

Mode  of  Shipment 

(MODE) 

Another  factor  that  might  be  expected  to  be  significantly  related  to 
an  item's  OST  characteristics  (suggested  by  Dr.  W.  Karl  Kruse  of  the  U.S. 

Army  Logistics  Management  Center)  is  the  likelihood  of  a DSU  requisition 
for  the  item  encountering  a backorder  condition  at  the  wholesale  supply 
level.  Army  ICPs  set  item  availability  levels  according  to  a formula  that 
involves  the  unit  price  of  the  item  and  the  average  requisition  quantity 
submitted  to  the  ICP  for  the  item.  A DSU  can  estimate  this  quantity  based 
on  its  own  requisitions  for  the  item.  Since  DSU  requisition  quantities  are 
based  on  an  EOQ  calculation,  it  can  be  shown  that  the  combination  of  unit 
price  and  requisitioning  quantity  occurring  in  the  availability  formula 
reduces  to  a dependence  on  the  unit  price  times  the  DSU  demand  rate  for  the 
item  - that  is,  the  $-demand  value  for  the  item.  An  analysis  was  made  of 
the  relationship  of  item  OSTs  and  this  item  parameter  value  to  determine 
if  it  might  be  a fruitful  item  characteristic  to  use  for  item  classification. 

It  was  concluded  that  this  is  not  the  case.*  This  result  is  perhaps  not  surprising 


A more  detailed  description  of  this  analysis  is  given  in  the  memorandum 
"The  Use  of  Demand  Value  as  an  OST  Item  Group  Criterion,"  R.  H.  Davis, 

3 March,  1978. 
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since  backorders  occur  on  only  a small  fraction  of  an  item's  requisitions 
and  when  they  do  occur  the  incremental  time  added  to  the  OSTs  is  only  the 
final  portion  of  depot's  OST  from  its  source  of  supply. 

Returning  to  the  item  classification  factors  listed  above,  the  RIC 
indicates  the  cognizant  DOD  National  Inventory  Control  Point  to  which  the 
item  is  assigned  and  through  which  the  item's  replenishment  requisitions  are 
processed.  The  ALOC  indicator  signals  those  requisitions  that  are  to  be 
routinely  shipped  by  air  from  CONUS  depots  to  overseas  DSUs.  DEPOT  indicates 
the  identity  of  the  depot  from  which  a full  or  partial  shipment  of  a requisition 
quantity  is  shipped.  MODE  indicates  the  primary  mode  of  shipment  from  the  depot  to  the 
DSU.  By  sorting  on  MODE  within  DEPOT  within  RIC  within  ALOC  for  a particular 
DSU,  and  developing  OST  statistics  at  each  level  of  aggregation,  it  was  de- 
termined that  differences  in  OSTs  for  different  MODEs  and  DEPOTS  were  sta- 
tistically insignificant.  However,  such  differences  for  differing  RICs  and 
ALOCs  (applicable  to  only  overseas  DSUs)  were  significant.  Nearly  all  over- 
seas Class  IX  Repair  Parts  items  were  phased  onto  the  ALOC  system  at  about  mid- 
period in  the  LIF  OST  data.  Since  this  is  the  situation  of  interest  in  the 
future,  only  ALOC  requisitions  were  considered  for  the  overseas  DSU. 

For  each  RIC  the  requisition  statistics  (number,  mean,  and  standard  deviation) 
for  each  sample  DSU  were  computed.  Utilizing  these  statistics,  the  RICs  for 
a given  DSU  were  grouped  into  RIC-groups,  among  which  there  were  no  statistically 
significant  difference  in  OSTs.  These  RIC-groups  then  formed  the  basic  item- 
groups  for  forecasting  OST.  The  basic  criteria  for  "clustering"  RICs  into 
RIC-groups  were  that  they  have  OST  means  whose  practical  or  statistical  dif- 
ferences are  insignificant.  Symbolically,  letting 

N^  » the  number  of  OST  observations 
(requisitions)  for  a RIC 

X * the  mean  OST  for  that  RIC 

» the  standard  deviation  of  OSTs  for  that  RIC 
and  N2,  X2,  be  the  corresponding  quantities  for  another  RIC, 
the  differences  in  the  OSTs  for  two  RICs  were  considered  to  be  insignificant 
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if 


< 2.5  days 


or 


X,  - X„ 


2 ' < 


1.65 


where 

0 = \J  (°12  /V  + (°22  /V 

The  clustering  procedure  was  as  follows: 

1.  Select  the  RIC  having  the  largest  number  of  OST 
observations  (N) 

2.  Apply  the  cluster  criteria  to  this  RIC  and  each  of  the  other 
RICs,  and  group  those  RICs  satisfying  the  criteria  into  a 
single  RIC  group 

3.  Eliminate  these  RICs  from  further  consideration  and  repeat  steps 
1,  2,  and  3 until  all  RICs  for  the  DSU  are  grouped. 
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D.  Item/Group  Classification 

The  grouping  of  items  into  RXC  groups  is  for  the  purpose  of  generating 
OST  forecasts  for  those  items  within  the  groups  that  have  an  insufficient 
number  of  observations  to  yield  a statistically  significantly  different 
mean  than  that  of  the  RIC  group.  For  such  items  the  group  forecast  can 
provide  a much  more  timely  and  adaptive  indication  of  an  item's  current 
and  future  OST  than  a forecast  based  on  only  the  item’s  historical  OST 
observations.  This  is  particularly  true  for  slower-moving  items  that  have 
low  order  frequencies  (e.g.  once  or  twice  per  year).  If  only  item-fore- 
casts  are  utilized,  such  items  would  have  their  forecasts  updated  corre- 
spondingly infrequently.  On  the  other  hand,  the  group  forecast, 
based  on  much  more  frequently  occurring  OST  observations,  provides  much 
more  timely  and  adaptive  forecasts ( for  those  items  having  essentially 
the  same  OST  characteristics  as  the  group)  during  the  possibly  lengthy 
interim  between  OST  occurrences  and  updates  of  an  individual  item's  fore- 
cast. For  example,  if  an  item  at  an  overseas  DSU  has  a replenishment  re- 
quisition placed  and  delivered  before  converting  to  ALOC  status  and  the 
next  requisition  is  placed  after  this  transition,  the  item  OST  forecast 
for  the  second  requisition  would  be  based  entirely  on  pre-ALOC  OST  obser- 
vations, which  could  lead  to  a substantial  error  in  the  timing  of  this 
requisition,  through  the  erroneous  ROP,  as  well  as  in  the  order  quantity, 
through  the  erroneous  RO.  On  the  other  hand,  group  forecasts  would  have 
been  made  frequently  during  the  transition  of  items  from  non-ALOC  to 
ALOC  status  and  would  have  adapted  continuously  to  the  changing  OST  values, 
thus  providing  a more  accurate  OST  forecast  for  the  second  requisition 
for  the  item.  This  is  true  as  long  as  the  OST  characteristics  for  the  item 
are  insignificantly  different  from  the  group.  Consequently,  whenever 
warranted  it  is  desirable  to  utilize  group  rather  than  item  OST  fore- 
casts. However,  if  the  OST  observations  for  an  item  give  a mean 
that  is  significantly  different  from  the  group  mean,  then  forecasts  based 
on  the  item  OSTs  would  be  more  accurate  than  those  based  on  the  group.  Con- 
sequently, items  could  be  classified  as  "group-forecast"  or  "item-forecast" 
depending  on  whether  the  group  and  item  means  are  significantly  different.  Or, 
alternatively,  an  appropriately  weighted  mean  of  the  group  and  item  forecasts 
could  be  taken  as  the  item  forecast.  A natural  weighting  would  be  the  res- 
pective probabilities  that  the  item  and  group  means  calculated  from  the  OST 
observations  are  or  are  not  based  on  samples  from  the  same  OST  population. 


Letting 


N = the  number  of  OST  observations  used  to 
o 

calculate  the  group  mean 
Xq  = the  group  mean 

Oq  = the  standard  deviation  of  the  group  OST 
observations 


= the  number  of  OSTs  used  to  calculate  the 
item  mean  OST 


= the  item  mean  OST 


= the  standard  deviation  of  the  item  OST 
observations 


Then  the  probability  that  the  two  sample  means  are  based  on  the  same  OST 
population  is  given  by 


P = 2-N  (>  |t|  ) 

where  t is  the  standardized  normal  deviate  of  the  observed  difference  between 
the  item  and  group  OST  means  and  N(>xj  is  the  probability  that  the  standardised 
normal  deviate  exceeds  x.  That  is, 


t = (X  - X )/o 
1 o 


where 


o 


The  expected  value  of  the 


V(V/No)  + (<V/N1) 

item  OST  mean  would  then  be 


X - P*X  +(1-P)-X, 
o 1 


* This  expression  neglects  the  effect  of  removing  the  item  from  the  group  on 
the  residual  group's  statistics,  a valid  assumption  since  N is  generally  large 
compared  to  . 
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These  same  mixing  factors,  P and  (1-P) , can  then  be  used  to  combine 
item  and  group  forecasts.  Thus  if  it  is  likely  (i.e.,  P is  large)  that 
the  item  and  group  OST  are  samples  from  the  same  population,  the  expected 
OST  forecast  is  near  the  group  forecast,  and  approaches  the  item  forecast 
as  P becomes  small. 


Other  wieghting  factors  may  be  used.  In  particular,  W.  Karl  Kruse  has 
reported*  the  use  of  a weighting  function  of  the  form: 

W = 1/ (1+N^/m) 

where 


and 


N 


1 


the  number  of  item  OST  observations 


m = an  empirically  determined  parameter 
The  weighted  average  forecast  is  then  given  by: 


X = W • Xq+  (1-W) . xL 

In  that  study  the  most  appropriate  value  of  m depended  on  the  degree 
of  truncation  of  the  OST  value  used  in  determining  the  forecasts,  varying  from 
7 for  no  truncation  to  3 for  one  standard  deviation  truncation.  The  above 
weighting  expression  takes  into  account  only  the  number,  N^,  of  item  OST 
observations,  whereas  it  can  be  seen  above  that  not  only  this  value  but  other 
item  sample  statistics,  as  well  as  group  statistics,  should  also,  in  principle, 
be  considered.  However,  since  the  number  (Nq)  of  group  observations  is  generally 
quite  large  compared  to  N^,  the  group  OST  mean  can  probably  be  well  approximated 
by  a fixed  value  (Xq)  with  no  uncertainty.  The  above  weighting  expression,  W, 
does  not  explicitly  consider  the  variability  of  item  OSTs  indicated  by  the  item 
OST  sample.  However,  it  is  somewhat  simpler  than  the  "expected  value"  weighting 
scheme  described  previously. 


* "Forecasting  Order  and  Ship  Time  for  CONTJS  Depots",  June,  1977,  DRC 
Inventory  Research  Office,  U.S.  Army  Logistics  Management  Center. 
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In  order  to  evaluate  the  "item  classification"  and  "empirical 
weighting"  procedures  versus  the  "expected  value"  procedure,  sample 
calculations  were  performed  for  a range  of  values  of  deviations  of  item 
means  from  group  means.  Since  the  degree  of  OST  truncation  used  in  the 
present  study  was  intermediate  between  the  extremes  used  in  the  Kruse  study 
the  value  m = 5,  was  used.  Also,  typical  values  of  30  days  for  the  group 
mean  (Xo),.50  for  the  item  standard-deviation-to-mean  ratio,  and  6 for  the 
number  (N)  of  item  OST  observations,  have  been  used.  The  item  was  classi- 
fied as  item-forecast  if  the  mixing  factor  P is  less  than  0.5,  and  group- 
forecast  otherwise.  The  results  are  given  in  Table  III-l. 

It  is  seen  that  the  deviations  of  the  empirically  weighted  OST  mean 
from  the  expected  OST  mean  become  quite  large  for  relatively  large  deviations 
of  the  item  OST  mean  from  the  group  mean.  On  the  other  hand,  corresponding 
deviations  of  the  classified  item  OST  means  are  not  more  than  2.5  days, 
being  less  for  large  deviations  of  item  from  group  means.  Consequently,  it 
is  concluded  that  the  use  of  either  the  expected  or  classified  item  forecasts 
constitutes  a satisfactory  procedure  for  combining  item  and  group  OST 
forecasts.  However,  the  classification  scheme  would  be  simpler  to  use  in 
practice  since  the  expected-value  technique  requires  the  use  of  both 
the  item  forecast  and  its  item-group  forecast,  as  well  as  a calculation 
of  the  probability  weighting  factor  for  each  forecast.  For  the  item/group 
classification  procedure,  the  classification  could  be  updated  periodically 
(say,  annually)  and  during  the  interim  only  the  item  or  group  forecast 
is  used. 
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ITEM/GROUP-FORECAST  ALTERNATIVES 

Group/Item  Expected  Group/Item  Weighted  Item/Group  Classified 

Item  Mixing  Item  Weighting  Item  Classi-  Item 


t 
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E. 


OST-Forecast  Error  Evaluation 


A simulation-evaluation  computer  program  was  developed  (described  in 
the  first  of  the  memoranda  indicated  above)  for  accepting  input  OST-time- 
series  data  of  OST  originations  and  completions,  applying  the  forecasting 
models  to  these  data,  and  calculating  measures  of  forecast  performance 
throughout  the  simulations.  This  forecast  evaluator  was  used  to  calibrate 
the  parameters  of  the  various  models,  and  to  determine  a first-screening  of 
the  models  based  on  forecast  accuracy  alone.  This  evaluation  does  not  take 
into  account  the  inventory  effects  resulting  from  the  use  of  OST  forecasts  in 
controlling  item  inventories  at  the  DSUs,  but  assumes  that  there  is  a sufficient 
correlation  between  forecast  error  and  these  inventory  effects  that  a first 
screening  of  OST  models  can  be  carried  out  by  means  of  a forecast  error  evalu- 
ation alone. 

When  the  OST-forecast  models  are  applied  to  a time  series  of  OST  obser- 
vations and  the  successive  OST  forecasts  are  compared  with  the  actual  OST 
observations,  a series  of  forecast  errors  are  generated.  The  fundamental 
measure  of  forecast  error  for  calculating  the  overall  performance  of  a model 
in  any  such  simulation  was  the  root-mean-square-error  (RMSE) . This  is  defined 
as  the  square  root  of  the  average  squared  error  occurring  during  the  simulation. 
This  is  a commonly  used  measure  of  fit  of  one  time  series  (the  OST  forecasts) 
to  another  series  (the  OST  observations)  that  has  theoretical  justification 
for  certain  types  of  error  distributions  (Normal).  When  the  values  of  the 
RMSE  for  two  models  (or  two  setfs  of  parameter  values  for  the  same  model)  are 
significantly  different,  the  one  having  the  smaller  RMSE  was  judged  to  be 
superior.  In  the  case  where  there  is  an  insignificant  difference  in  the  RMSE 
values,  another  measure  (RMSE')  estimating  the  deviations  of  the  OST  forecasts 
from  the  OST  mean  was  used  to  evaluate  the  relative  performance  of  the  models. 

The  rationale  for  this  procedure  is  that,  in  principle,  it  is  desired  to  fore- 
cast the  individual  OST  observations,  as  closely  as  possible,  and  the  RMSE 
is  a measure  that  indicates  this.  If  the  OST  forecasts  are  perfect,  all 
forecast  errors  are  zero  and  the  resulting  RMSE  will  be  zero.  On  the  other 
hand,  if  the  inherent  variability  of  the  OST  observations  is  large  (as  tends  to 
be  the  case  for  the  data  utilized  in  the  present  study,  and  presumably  in  general) 
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and  the  OST  forecasting  models  are  of  the  smoothing  type  such  as  the 
average,  median,  or  mode  of  some  number  of  observations  or  exponential  smoothing, 
then  a "good"  forecasting  procedure  is  one  that  estimates  the  true  OST 
mean  as  closely  as  possible.  For  forecasts  of  this  type  the  RMSE  value 
results  primarily  from  the  large  inherent  OST  variability,  and  therefore 
relatively  small  differences  in  RMSE  values  may  be  obscured  by  this  vari- 
ability. Consequently,  when  this  is  the  case,  the  estimated  error,  RMSE' , 
of  the  forecast  from  true  OST  mean  is  used  as  secondary  indicator  of  fore- 
cast performance.  A more  detailed  discussion  of  this  subject  is  given  in 
the  memo  "OST-Forecasting  Evaluation  Measures",  R.H.  Davis,  9/20/77. 

F.  Inventory  Effect  Evaluation 

Since  the  purpose  of  forecasting  item  OSTs  for  a DSU  is  for  use  in 
formulas  controlling  the  timing  and  quantitites  of  requisitions  for  replenish- 
ment of  stock  at  the  DSU,  the  ultimate  criteria  for  evaluating  OST  forecasting 
procedures  should  depend  on  this  effect  on  the  performance  of  the  inventory 
control  system.  A calculation  of  these  effects  can  be  obtained  by  combining 
the  statistics  of  the  OST  forecast  errors  for  the  various  models,  with  the 
inventory  control  rules  and  individual  item  parameters,  and  calculating  the 
resulting  inventory  levels  and  not-in-stock  (NIS)*  rates  for  a cross-section 
sample  of  items  for  a DSU.  The  rationale  and  details  of  this  procedure  are 
given  in  the  technical  memorandum  "Analytic  OST-Forecasting  Inventory  Control 
Evaluator",  R.  H.  Davis,  9/13/77,  as  amended  in  Appendix  C.  the  basic  input 
parameters  required  for  this  analysis  are: 

System  parameters  - 

h = inventory  holding  cost  rate  (%  per  year) 

A - the  fixed  order  (requisition)  cost  ($) 

S = the  safety  stock  coverage  period  (days) 

Item  parameters 

c ■»  item  unit  cost  (price)  ($) 

D » item  demand  rate  (units/day,  month,  year) 

s =*  average  item  demand  quantity  (units) 

ag  = standard  deviation  of  demand  quantity  (units) 

L ■ item  OST  mean 


* This  measure  of  inventory  system  service-level  is  the  complement  of  the 
demand  satisfaction  rate:  NIS=l-Demand  Satisfaction  rate. 
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OST-forecast  parameters  - 

E = OST  forecast  bias  (average  forecast  error) 

o„  = standard  deviation  of  OST  forecast  error  from 
E 

actual  OST 

o , = standard  deviation  of  OST  forecast  from  mean  OST 

E 

From  these  parameters,  the  resulting  expected  inventory  levels,  I, 
and  NIS  rates  were  calculated  for  each  sample  item  and  each  OST  forecasting 
model,  and  also  the  expected  sample  inventory  value  and  value-averaged 
sample  NIS  rate  were  computed  for  the  sample  of  items  for  each  OST  forecasting 
model. 

As  a basis  for  comparison,  the  corresponding  inventory  performance 
measures  were  also  determined  for  the  perfect  OST  forecast  (that  is, 

E = a£  - aE,  * 0),  The  error  parameters  for  each  OST  forecasting  model 
then  yield  incremental  deviations  in  inventory  levels  and  NIS  rates  from 
those  of  the  perfect  OST  forecast.  However,  since,  in  general,  both  the 
inventory  level  and  NIS  rate  for  an  OST  forecasting  model  are  different  from 
those  for  the  perfect  forecast,  and  other  models,  it  is  difficult  to  interpret 
the  relative  quality  of  inventory  performance  resulting  from  the  various  models. 
For  example,  if  the  inventory  level  for  the  model  is  higher  than  that  for 
another  model,  but  the  NIS  rate  is  lower,  then  the  question  arises  as  to  whether 
or  not  the  reduction  in  NIS  rate  more  than  compensates  for  the  inventory 
increase.  The  technique  used  in  the  present  study  for  normalizing  the  per- 
formance measure  for  all  models  was  to  artificially  adjust  the  safety  stock 
parameter,  S,  used  in  setting  the  item  inventory  levels  (reorder  point  and 
requisitioning  objective),  so  that  the  NIS  rate  for  each  model  is  the  same 
as  that  for  the  perfect  forecast.  Then  the  corresponding  increases  in  in- 
ventory above  those  for  the  perfect  forecast  constitute  a single  performance 
measure  that  can  be  used  to  indicate  the  relative  inventory  effects  of  each  of 
the  models  evaluated. 


G. 


Summary  of  OST-Forecasting  Methodology 

In  summary,  the  methodology  followed  in  evaluating  OST  forecasting 
models  for  each  sample  DSU  was: 

1.  Process  the  LCA/LIF  data  to  obtain,  for  all  ASL  items  having 
six  or  more  computable  OSTs,  all  requisitions  of  routine 
priority. 

2.  Sort  requisitions  by  item  (NSN)  within  RIC  and  calculate  item 

OST  statistics  (N,X,a  ) and  demand  rates,  as  well  as  RIC  OST 

A 

statistics  (N,  X,cr  over  all  RIC  requisitions). 

A 

3.  Collect  RIC  requisitions  into  RIC  groups  of  requisitions  by  means 
of  a cluster  analysis  procedure,  and  calculate  the  RIC-group 

OST  statistics. 

4.  Generate  time  series  of  OST  originations  and  completions  for  each 
RIC-group  and  each  item  within  the  group. 

5.  Select  the  major  RIC-group  and  a sample  of  typical  items  from 
this  group. 

6.  Classify  sample  items  into  item-forecast  or  group-forecast. 

7.  Evaluate  OST  forecasting  models  for  group-forecast  items  by 
applying  the  OST-forecast  simulator /evaluator  computer  program 
to  the  RIC-group  time  series  of  OSTs. 

8.  Evaluate  OST  forecasting  models  for  item  forecast  items  by 
simulating  using  the  item  time  series  of  OSTs. 

9.  Screen  out  the  less  promising  models  based  on  the  results  of 
steps  7 and  8. 

10.  Evaluate  the  remaining  models  by  means  of  the  inventory  effects 
evaluator  applied  to  a cross-sectional  item  sample,  using  the 
OST-forecast  error  statistics  obtained  in  steps  7 and  8. 
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H.  Reorder  Point/Requisitioning  Objective  Updating 


Current  Army  policy  is  to  update  the  reorder  point (ROP)  and  re- 
quisitioning objective  (RO)  whenever  the  inventory  position  of  an  item 
falls  to  or  below  the  current  reorder  point.  The  consequences  of  this 
policy  may  be  compared  to  maintaining  current  ROP  and  ROs  and  analyzed 
under  different  assumptions  concerning  increasing  or  decreasing  demand 
rates  and  OSTs.  This  analysis  is  described  in  more  detail  in  Section  VIII. 
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IV.  RESULTS  FOR  THE  704TH  MAINTENANCE  BN.  (CONUS) 


A.  RIC-Groups 

For  the  CONUS  DSU  (704th  Maintenance  Bn)  the  RIC  statistics 

were: 


Group  I: 


RIC 

N 

X (days) 

c^(days) 

AKZ 

2056 

40.6 

18.4 

AP5 

4 

57.3 

19.4 

A12 

121 

34.8 

12.9 

A35 

102 

46.8 

14.5 

B14 

455 

36.5 

14.8 

B16 

91 

45.7 

21.9 

B17 

1 

71.6 

- 

FFZ 

29 

40.0 

16.1 

FHZ 

5 

34.2 

7.9 

FLZ 

19 

38.4 

12.0 

MPB 

4 

48.2 

11.3 

N35 

6 

37.0 

5.6 

S9C 

635 

38.3 

16.5 

S9E 

327 

37.4 

14.2 

S9G 

413 

44.8 

15.4 

S9I 

752 

37.9 

14.1 

S9T 

3 

25.7 

9.5 

s cluster  procedure 

Co  these  data  yields 

I: 

AKZ,  FFZ, 

FLZ 

, N35 , S9C, 

S9E,  S9I 

(N  - 3824 

, x 

■ 39.4  days 

, ax  = 17 

II: 

B14 , A12 , 

FHZ 

(N  - 581, 

X 

* 36.1  days 

’ ax  " 14 

17.0  days) 


14.4  days) 


* The  cognizant  agencies  corresponding  to  these  RICs  are  given  in 
Appendix  B. 


29 


Group 

III: 

A35 , 

B16 , 

MPB, 

S9G 

(N  = 

610, 

X = 

45.3,ax= 

16, 

.4) 

Group 

IV: 

AP5, 

B17 

(N  - 

5,X 

- 

60.0,ox= 

17, 

.9) 

Group 

V: 

S9T 

(N  - 

3,X 

- 

25.7,ox= 

9. 

.5) 

The  major  RIC-group  for  this  DSU  is  seen  to  be  Group  I.  This 
group  had  3824  OST  observations  with  an  average  OST  of  39.4  days  and  a 
standard  deviation  of  17.0  days.  The  overall  performance  of  the  OST  fore- 
casting models  on  all  "group-forecast"  items  within  this  RIC  group  can 
be  determined  by  applying  the  models  to  the  OST  time  series  for  this  group. 
The  use  of  all  3824  observations  (an  average  of  about  11  per  day)  would 
constitute  a far  more  fine-grained  simulation  than  is  required  to  determine 
the  relative  merit  of  the  forecasting  models,  and  would  entail  time-consuming 
and  costly  data  preparation  and  computer  running  time.  Consequently,  in 
order  to  utilize  the  project  resources  in  a more  cost  effective  manner,  the 
RIC  group  OST  time  series  was  randomly  sampled  to  obtain  OST  series  spanning 
the  same  time  period  with  fewer  observations  having  essentially  the  same 
statistical  characteristics. 

B.  Model  Parameter  Determination 

Each  of  the  OST  forecasting  models  has  one  or  more  parameters  that 
must  be  specified  before  numerical  applications  can  be  made  to  any  OST  time 
series.  For  the  purpose  of  determining  these  parameter  settings  for  each 
model,  a random  sample  of  120  OST  observations  was  selected  from  the  set  of 
all  OST  ODServations  for  the  RIC-groupi  The  statistics  of  this  sample  were 
X = 40.4  days  and  » 17.3  days  versus  X =*39.4  days  and  * 17.0  days 
for  the  entire  RIC  group.  The  sample  was  considered  to  be  an  adequate  re- 
presentation of  the  RIC  group  for  the  purposes  of  calibrating  the  parameters 
of  the  models. 
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The  results  of  applying  the  OST  forecasting  models  to  this  OST 
time  series  for  various  model  paramter  values  by  means  of  the  OST  forecast 
error  simulator/evaluator  program,  are  shown  in  Table  IV-1.  For  some 
models  an  estimate  of  the  standard  error  of  the  RMSE  and  RMSE'  measurements 
have  been  calculated  and  are  indicated  following  their  respective  values 
in  Table  IV-1. 

For  the  model  OSTN  (average  of  last  N)  it  is,  seen  that  the  RMSE  per- 
formance measure  is  not  significantly  different  for  N=6  and  N=12;  however, 
the  RMSE'  measure  shows  a significant  improvement  over  N*12,  and  the  RMSE' 
indicates  a statistically  significant  but  very  small  such  improvement. 
Consequently,  the  parameter  value  adopted  for  OSTN.  was  N=24. 

The  results  for  OSTM  (median  of  last  N)  are  similar  and  the  parameter 
value  taken  for  this  model  was  N»24. 

For  OSTMO  (mode  of  last  N)  the  RMSE  shows  a generally  deteriorating 
performance  as  N increases,  with  a barely  significant  slight  improvement 
tor  N“24  over  N“12 . The  RMSE'  measure  indicates  a continually  decreasing 
performance  as  N increase.  Therefore,  the  parameter  chosen  for  this  model 
was  the  lowest  value  tested,  N*6.  This  result  is  in  contrast  to  that  for 
OSTM  (median).  Both  the  median  and  mode  are  biased  low,  but  the  mode  more 
so  than  the  median.  For  small  OST  samples  the  bias  is  not  as  great  as  for 
larger  samples.  Consequently,  as  the  sample  size  increases  the  increasing 
bias  competes  with  the  decreasing  variance  of  the  error  to  yield  the  total 
error  measures  RMSE  and  RMSE' . Apparently  the  increasing  bias  predominates 
for  the  mode,  but  not  for  the  median  whose  performance  continues  to  improve 
for  larger  OST  samples. 

For  OSTT(average  of  OSTs  in  last  time  period  T)  the  RMSE  does  not 
show  a significant  difference  for  the  different  T values.  The  RMSE'  in- 
dicates a significant  increase  in  performance  for  T-180  days  over  T-90  days, 
but  no  further  significant  improvement  for  T-360.  Consequently,  the  value 
of  T taken  for  this  model  was  180  days.  In  the  case  of  this  model,  the  fact 
that  a sample  rather  than  the  entire  RIC  group  of  OSTs  was  used  must  be 
taken  into  account.  The  number  of  sample  OSTs  occurring  in  a time  period  T 


31 


TABLE  IV-1 


PERFORMANCE  OF  OST-FORECAST  MODELS  FOR  ALTERNATIVE  MODEL 
PARAMETER  VALUES 


Principal 

OST-Forecast 

Parameter 

Model 

Value 

RMSE 

RMSE' 

OSTN 

N - 

6 

18.90  + .13 

7.32 

+ .05 

N = 

12 

19.04  + .12 

5.74 

+ .01 

N = 

24 

17.40  + .12 

5.58 

+ .04 

OSTM 

N - 

6 

18.35 

7.12 

+ .04 

N - 

12 

18.67 

5.31 

+ .04 

N - 

24 

16.64 

3.57 

+ .04 

OSTMO 

N « 

6 

18.65  + .11 

8.04 

+ .05 

N - 

12 

20.13  + .14 

9.26 

+ .09 

N - 

24 

19.70  + .13 

9.62 

+ .06 

OSTT 

T « 

90  days 

18.71 

3.35 

+ .05 

T = 

180  " 

18.83 

2.67 

+ .10 

T = 

360  " 

18.70 

2.68 

+ .14 

OSTNE 

e a 

.05 

18.74 

2.71 

+ .14 

e ■ 

.10 

18.68 

4.69 

+ .06 

e a 

.20 

19.04 

7.43 

+ .71 

OSTES 

T * 
X 

■ 90  days 

17.77 

3.61 

+ .06 

T ■ 
X 

180  " 

17.81 

2.45 

+ .05 

T ■ 

X 

■ 360  " 

17.86 

2.13 

+ .02 

OSTDES 

F - 

1.0 

20.99 

8.92 

+ .63 

F - 

0.7 

20.28 

8.53 

+ .62 

F - 

0.5 

19.88 

8.29 

+ . 62 

OSTR 

N - 

6 

20.35  + .11 

8.80 

+ .05 

N - 

12 

19.07  + .12 

7.86 

+ .04 

N - 

24 

17.53  + .15 

5.66 

+ .04 

OSTNP 

UDI 

- 7 days 

18.33  ) 

5.41 

UDI 

-15  " 

18.85  / (vs  18.73)* 

5.81 

.(vs  5.75 f 

UDI 

-30  " 

18.86) 

6.39 

OSTESP 

UDI 

- 7 days 

17.48) 

2.32 

) 

UDI 

-15  " 

17.63Hvs.17.81)* 

2.32 

) (vs  • 2.58)* 

UDI 

-30  " 

17.55 

2.43 

1 

* For  the  corresponding  non-periodic  models. 
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is  only  about  120/3824  as  many  RIC-group  OSTs  as  would  occur  in  this  time 
period.  To  translate  time  periods  for  OSTT  from  the  sample  OST  time  series 
to  any  other  it  is  necessary  to  normalize  the  period  by  the  ratio,  of  the 
OST  occurrence  rates  for  the  two  series.  Since  the  total  time  spanned  by 
the  sample  and  RIC-group  OST  series  are  the  same,  the  appropriate  ratio  is 
that  given  above  for  the  numbers  of  observations  in  the  two  series.  This 
means  that  the  corresponding  parameter  values  for  the  complete  RIC-group  OST 
series  would  be  about  T=3,  6,12  days  compared  to  the  value  T=90,  180,  360 
days  for  the  sample.  So  the  use  of  T=180  for  the  sample  series  would  correspond 
to  a T of  about  one  week  for  the  entire  RIC  group. 

For  the  OSTNE  (average  of  last  N necessary  to  produce  a specified  error, 
e,  in  the  forecast  of  the  OST  mean)  the  RMSE  shows  very  little  difference 
for  the  various  e values;  however,  the  RMSE'  shows  a pronounced  deterioration 
in  performance  of  the  forecast  as  e increases.  Consequently,  an  error  of  e=.05 
was  selected  as  the  parameter  to  use  for  this  model. 

The  model  OSTES  (adaptive  exponential  smoothing)  has  several  parameters: 

T = the  time  period  over  which  an  expected  number  of  OST 

a 

occurrences  is  calculated.  Short  periods  give  more  dynamically 
responsive  OST  forecasts. 

T^  - the  time  period  over  which  an  expected  OST  inter-arrival  interval 
is  calculated.  Short  periods  give  more  responsive  estimates 
of  this  inter-arrival  interval. 

e . = the  desired  minimum  error  of  the  forecast  of  OST  mean: 
min 

e =*  the  desired  maximum  error  of  the  forecast  of  OST  mean 
max 

The  value  chosen  for  T depends  upon  the  time  period  over  which  it  is 

A 

desired  to  detect  changes  in  the  OST  mean.  The  value  e . has  the  effect 

min 

of  shortening  T^  (that  is,  making  the  forecast  more  responsive)  in  case  the 
error  of  the  OST-mean  forecast  using  T^  would  be  smaller  than  desired. 
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e has  the  opposite  effect  in  case  the  error  using  T would  be  greater  than 
nicix  X 

desired.  The  values  chosen  for  e . and  e were  .05  and  .20. 

min  max 

The  value  of  T^  depends  on  the  time  period  over  which  it  is  desired  to 

detect  changes  in  mean  OST  arrival  rate,  which  depends  on  the  change  in  demand 

rates  of  the  items  in  the  RIC  group.  Typically  the  demand  processes  are  more 

dynamic  than  the  OST  process,  so  that  an  appropriate  value  for  T^  tends  to  be 

smaller  than  that  for  T . For  the  alternative  values  of  T chosen  (90,180, 

X X 

360  days)  the  corresponding  values  of  T^  were  90,  90,  180  days. 

The  RMSE  is  not  significantly  different  for  the  alternatives,  whereas 

the  RMSE'  shows  a significant  improvement  for  180  days  over  90  days  and  only 

a slight  further  improvement  for  360  days.  Since  in  order  to  maintain  forecast 

responsiveness  it  is  desirable  to  make  T no  longer  than  actually  required, 

X 

the  value  of  T =180  (and  T =90  days)  was  selected  for  the  OSTES  model. 

X A 

The  parameters  of  the  OSTDES  (adaptive  double  exponential  smoothing)  are 
the  upper  and  lower  limits  on  the  smoothing  constant,  as  calculated  from  the 
tracking  signal,  and  the  fraction,  F,  of  the  trend  and  lag  correction  utilized 
by  the  procedure.  Typical  values  for  the  smoothing  constant  limits  have  been 
0.1  and  0.3  in  previous  applications,  and  these  were  assumed  in  the  present 
case.  Neither  the  RMSE  or  RMSE'  indicate  very  significant  differences  for  the 
alternative  values  of  F (1,0,  0.7,  0.5);  however,  there  is  a slight  indication 
of  improvement  as  F decreases.  The  value  of  F=0.7  was  selected  for  this  model. 

For  OSTR  (least  squares  regression,  or  trend,  line  based  on  the  last  N 
OST  observations)  both  the  RMSE  and  RMSE'  indicate  significant  improvement  as 
N increases  from  6 to  24.  The  value  N=24  was  used  for  further  evaluation  of 
this  model. 

The  remaining  two  models  OSTNP  and  OSTESP  are  periodic-update  versions 
of  0STN  and  OSTES.  As  such,  the  question  for  these  models  is  not  the  best 
parameter  value  (update  interval,  UDI)  but  the  extent  of  the  effect  on  the 
quality  of  the  forecast  as  the  update  interval  is  increased.  For  each  of  these 
two  models,  alternative  update  intervals  of  7,14  and  30  days  were  used.  For 
OSTNP  the  value  N-12  was  used  and  for  OSTESP  the  values  TY  = 180  days,  T = 90  day, 

X A 

e * .05,  e = .20  were  used.  The  performance  of  the  periodic  update  models 
rain  max 

are  to  be  compared  with  the  ati  hoc  update  models  having  the  same  parameter  values. 


34 


The  RMSE  and  RMSE'  values  for  these  latter  models  are  indicated  in 
parentheses  for  these,  two  periodic  update  models,  in  Table  IV- 1. 

For  OSTNP  the  RMSE  indicates  an  insignificant  change  in  forecast 
performance  resulting  from  updating  intervals  from  7 to  30  days.  The 
RMSE'  shows  a very  slightly  deteriorating  effect  as  UDI  increases  from 
7 to  15  days,  and  a more  pronounced  increase  in  error  for  30  days.  Also, 
for  UDI  = 7 days,  evidently  the  increased  smoothing  effect  of  the  periodic 
updating  increased  the  quality  of  the  forecast  sufficiently  to  more  than 
compensate  for  any  deteriorating  effect,  so  that  the  resultant  performance 
was  slightly  better  than  that  for  ad  hoc  updating.  This  is  indicated 
by  both  the  RMSE  and  RMSE'  measures. 

For  OSTESP  neither  the  RMSE  or  RMSE'  shows  any  significant  change  for 
UDI  ranging  from  7 to  30  days. 

Moreover,  as  in  the  case  of  OSTNP  for  UDI  = 7,  for  OSTESP  both  RMSE 
and  RMSE'  indicate  a slightly  improved  performance  for  all  UDIs  from 
7-30  days  over  the  corresponding  ad  hoc  forecasts. 

These  results  indicate  that  there  is  very  little  effect  on  the 
quality  of  OST  forecasts  resulting  from  the  utilization  of  update  in- 
tervals of  30  days  or  less. 

C.  Evaluation  of  OST-Forecast  Models 

The  alternative  OST-forecasting  models  were  evaluated  on  the  basis 
of  their  error  performance  for  both  RIC-group  and  individual  item  OST 
time  series  data.  The  group  data  were  obtained  as  a 202-observation 
random  sample  of  the  3824  RIC-group  I OST  observations.  Using  this  OST 
time  series  as  the  basis  for  both  generating  the  forecasts  and  the  time 
series  of  OSTs  being  forecasted  yields  the  composite  performance  of  each 
model  on  all  items  within  the  group  that  are  classified  as  "group-forecast" 
items.  When  the  group  OST  time  series  is  used  to  generate  the  forecasts 
and  an  individual  "group-forecast"  item's  OST  time  series  is  used  as 
the  forecasted  OSTs,  a model's  performance  refers  to  that  particular  "group- 
forecast"  item.  For  an  "item-forecast"  item  a time  series  of  OSTs  for 
that  item  is  used  for  both  the  generation  of  the  OST  forecasts  and  as  the 
forecasted  OST  time  series. 
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1.  RIC-Group  Data 

The  results  of  using  the  RIC-group  sample  OST  series  for  generating 
the  forecasts  and  as  the  forecasted  series  are  shown  in  Table  IV-2 , it 
can  be  seen  that  both  RMSE  and  RMSE'  indicate  that  three  of  the  models 
have  significantly  poorer  performance  than  the  others  (indicated  by 
boxed  values),  among  which  there  is  little  difference  in  indicated  per- 
formance. Thus  RIC-group  evaluation  yields  the  models 

OSTN 

OSTM 

OSTT 

OSTNE 

OSTES 


as  those  most  promising  for  further  evaluation,  and  eliminates  OSTMO  (mode) , 
OSTDES  (double  exponential  smoothing) , and  OSTR  (least  squares  trend  line) 

from  further  consideration. 

2.  Item  Data 

In  order  to  evaluate  the  performance  of  the  OST-forecasting  models 


on  individual  items,  three  items  having  differing  OST  statistics  were 
selected  from  RIC-group  I.  They  were: 


NSN 


N X 


Over  the  time  period 


1.  2540  007146156 

2.  2530  006784131 

3.  2540  001345093 


8 40.1  days  12.2  days 

9 31.9  7.7 

10  63.8  18.3 


307  days 

287 

314 


'*  It  is  seen  that  for  individual  items  there  are  far  too  few  OST  observations  for 

an  adequate  simulation/evaluation  of  the  OST-forecasting  models.  Consequently, 
an  approximately  5-year  OST-time  series  was  generated  for  each  item  from 
their  respective  OST  statistics.  For  this  purpose  a shifted  log-Normal 
probability  distribution  was  used.  Both  the  simplicity  of  generating  random 
OST  sequences  according  to  this  distribution  and  the  adequacy  with  which  it 
was  possible  to  fit  the  RIC  and  RIC  group  OST  histograms  with  the  distribution 
led  to  its  use  for  this  purpose.  A shift  of  10  days  was  found  to  result 
in  a good  fit  of  the  log-Normal  to  the  actual  OST  data. 
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TABLE  IV-2 


ERROR  PERFORMANCE  EVALUATION  OF  OST-FORECASTING  MODELS 

DSU:  704th  Maintenance  Bn.  (CONUS) 

RIC-Group  I 
202-OST  Sample 


OST-Fo recasting 


Model 

RMSE 

RMSE' 

OSTN 

14.92+  .03 

— 

3.91+  .05 

OSTM 

15.02 

2.97+  .02 

OSTMO 

16.92 

6.94+  .08 

OSTT 

14.92 

3.66+  .04 

OSTNE 

14.77 

3.68+  .05 

OSTES 

14.62 

4.09+  .05 

OSTDES 

16.72 

5.45+  .17 

OSTR 

15.91+  .03 

4.28+  .07 

In  this  way  it  was  possible  to  obtain  quite  representative  OST  time 
series  for  the  three  test  items,  over  a sufficient  time  period  to 
simulate/evaluate  the  relative  performance  of  the  various  OST-fore- 
casting  models.  The  three  sets  of  time  series  used  are  given  in  Appendix  D. 
The  results  of  applying  the  OST  forecast  models  to  the  time  series  for  these 
three  items  are  given  in  Table  IV-3.  It  can  be  seen  that  the  performance 
of  the  models  on  these  item  OST  time  series  is  consistent  with  that  using 
the  RIC-group  time  series  above. 

Number  of  Items  for  Which  Model  was 
Model  Among  the  Best  Four 


OSTN  3 

OSTM  2 

OSTT  3 

OSTES  3 

OSTR  1 


It  was  not  possible  to  obtain  a valid  indication  of  the  performance 
of  the  model  OSTNE  (average  of  the  last  N OSTs  necessary  to  give  an  error 
of  forecast  of  OST  mean  of  5%).  The  numbers  of  observations  required  for  the 
successive  forecasts  during  the  simulation  of  the  model  were  always  greater 
than  the  number  of  OST  observations  available. 


Consequently,  based  on  the  error  performance  of  the  alternative  OST- 
forecasting  models  on  both  RIC-group  and  individual  item  OST  time  series, 
it  was  concluded  that  the  five  models: 

OSTN 

OSTM 

OSTT 

OSTNE 

OSTES 

appear  most  promising  for  more  definitive  evaluation  with  respect  to 
the  inventory  effects  of  OST  forecast  errors. 
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TABLE  IV-3 


PERFORMANCE  OF  OST-FORECASTING  MODELS  FOR  INDIVIDUAL  ITEMS 


DSU:  704th  Maintenance  Bn.  (CONUS) 
RIC-  Group  I 

5-year  Simulated  OST  Time  Series 


Item  No. 
NSN  : 

X : 


: 


2540-7146156 
42  days 
15  days 


2530-6784131 
30  days 
7 days 


2540-1345093 
64  days 
20  days 


OST-Forecasting 


Model 


OSTN 
OSTM 
OSTMO 
OSTT 
OSTNE  * 


RMSE  RMSE ' 


13.1+  1.0;  I 3.1+  .4 


3.2+  .4  ;( 


RMSE 


7.6+  .2 

8.0  ! 


RMSE'  | RMSE 


18.0+ 

3 

17.2 

] 13.6  | 


3.6+  .4 


II±J 


2.6+  .1 


17.8 


Four  Best 
Models 


RMSE' 


4.2+  .4) 


15.4+  1.0  7.8+  .7  | 10.8+  .4  6.4+  .4  j 20.5+  .8  8.8+  .7 


7.0+  .6  j 


OSTES 

13.6 

3.8+  .5 

I7*5  1 

1.9+  .2 

! . 18.6 
i 

6.0+ 

OSTDES 

16.2 

5.0+  .9 

8.4 

1.8+  .3 

25.1 

11.8+ 

OSTR 

13.8 

4.8+  .6 

7.6+  .2 

2.0+  .3 

1 

| 20.3+  .7 

7.8+ 

i 

f 

OSTN 

OSTN 

OSTN 

OSTM 

OSTT 

OSTM 

OSTT 

OSTES 

OSTT 

OSTES 

OSTR 

OSTES 

* 5-year  time  series  too  short  to  establish  steady  state  simulation 
conditions  for  this  model,  because  of  large  initialization  effects. 


3.  Effects  of  Using  Item  Forecasts  versus  Group  Forecasts 


The  effects  of  utilizing  item  forecasts  for  item-forecast  items 
can  be  seen  by  comparing  the  performance  of  RIC-group  forecasts  when 
applied  to  the  item  OST  time  series  to  those  given  in  Table  IV-3  for  the 
individual  item  forecasts.  These  effects  are  similar  for  the  various 
models.  For  the  OSTN  model  this  comparison  is  given  in  Table  IV-4. 

Item  No.  1 is  a "group-forecast"  item  and  one  would  not  expect  much 
difference  between  using  item  or  group  forecasts.  Both  the  RMSE  and 
RMSE'  performance  measures  indicate  that  this  is  the  case.  Item  No.  2 
is  an  "item-forecast"  item  having  an  OST  mean  (X  = 30  days)  considerably 
smaller  than  the  group  OST  mean  (X  = 38.5  days).  Both  performance  measures 
indicate  a substantial  deterioration  in  the  quality  of  the  group  forecast 
compared  to  that  of  the  item  forecast.  Item  No.  3 is  also  an  item-forecast 
item  with  OST  mean  considerably  larger  than  the  group  mean.  The  performance 
of  the  group-forecast  for  this  item  is  seen  to  be  much  poorer  than  that  of 
the  item  forecast.  These  results  illustrate  the  importance  of  utilizing 
item  forecasts  whenever  items  have  OST  characteristics  with  statistically 
significant  difference  from  those  of  the  RIC-group  to  which  they  belong. 
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TABLE  IV-4 


EFFECTS  OF  GROUP  AND  ITEM 

FORECASTS 

DSU:  704th  Maintenance 

Bn.  (CONUS) 

OSTN  Forecast  Model 

RIC-Group 

I 

N 

202  OST  Observations 

X 

38.5  days 

°x  - 

15.1  days 

Item  Number 

Item  OST 
Mean 

Type 

Forecast 

RMSE 

RMSE' 

1 

42  days 

Item 

13.1 

3.1 

Group 

14.6 

2.9 

2 

30  days 

Item 

7.6 

2.5 

Group 

14.3 

10.2 

3 

64  days 

Item 

18.0 

6.0 

Group 

32.5 

24.1 
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D.  Evaluation  Of  The  Inventory  Effects  of  OST-Forecasting  Models 

j 

The  OST-forecasting  models  having  the  most  promising  performance 
with  respect  to  forecast  error  were  further  evaluated  with  respect  to  their 
inventory  effects  performance.  These  models  were  OSTN,  OSTM,  OSTT,  OSTNE, 
and  OSTES.  As  discussed  above,  the  technique  employed  to  develop  a single 
performance  measure  for  each  model  was  to  determine  the  inventory  requirement 
above  that  for  a perfect  forecast,  necessary  to  give  the  same  not-in-stock 
(NIS)  rate  as  that  for  the  perfect  forecast.  . 

1.  Item  Sample 

t 

To  evaluate  inventory  effects  of  the  alternative  OST-forecasting  models 
it  is  necessary  to  select  a cross  section  of  individual  items  and  determine  I 

the  inventory  effects  for  each  item.  For  each  model  these  effects  depend  on 

4 

the  OST-forecasting  error  characterisitcs  and  the  various  item  parameters 

(demand,  price,  etc.)  of  the  item  sample.  Such  a cross  sectional  sample  1 

was  selected  for  this  DSU  from  the  RIC-group  I set  of  items.  The  items  were 
selected  to  reflect  a wide  range  of  price,  demand,  and  $-demand  values. 

They  consisted  of  10  group-forecast  items  and  the  two  item-forecast  items 
(items  No.  2 and  No.  3)  considered  above.  These  items  together  with  their 
parameter  values  are  given  in  Table  IV-5.  The  forecast  error  characteristics 
for  the  candidate  models  are  given  in  Table  IV-6.  These  were  obtained  from 
the  simulation/evaluation  computer  runs  performed  in  the  evaluation  of  the 
OST  forecasting  models  based  on  forecast  error,  as  discussed  above. 

2.  Inventory  Effects  Evaluation 

These  data  provided  the  input  to  the  inventory  effects  evaluator 
program  which  then  calculated  the  expected  inventory  level  and  NIS  rate 
fcr  each  item,  and  the  expected  inventory  value  and  $-demand-weighted  NIS  rate 
for  the  entire  sample  of  items.  These  results  are  given  in  Table  IV-7. 

As  discussed  in  general  above,  based  on  these  two  measures  there  is  some 
difficulty  in  determining  the  relative  quality  of  the  performance  of  the  various 
models  for  the  sample  items,  and  for  the  sample  as  a whole.  For  example, 
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Obtained  from  DSU  Demand  History  Report  (Class  IX  Repair  Parts-Common) 


TABLE  IV-6 


FORECAST  ERROR  PARAMETERS  FOR  OST-FORECASTINC  MODELS 

DSU:  704th  Maintenance  Bn .,;( CONUS) 

RIC-GROUP  I (12-item  cross  sectional  sample) 

« 

i " * 

OST  , Group  Forecast 


Forecast 

Model 

Items 

Item 

No. 11 

Item  No. 

12 

E 

°E 

V 

E o 

r 

E 

°E ' 

E 

°E 

V 

OSTN 

2.32 

14.7 

2.93 

-1.9 

7.3 

1.5 

4.2 

17.5 

3.5 

OSTM 

0.22 

15.0 

2.94 

-2.9 

7.4 

1.5 

-2.5 

17.0 

3.3 

OSTT 

3.30 

14.6 

1.86 

-1.8 

7.4 

1.7 

5.1 

17.0 

3.3 

OSTNE 

3.31 

14.4 

1.86 

-1.1 

8.5 

1.6 

4.1 

17.0 

3.0 

OSTES 

3.78 

14.1 

1.93 

-0.9 

7.5 

1.6 

3.7 

18.3 

3.3 

PERFECT 

0 

0 

0 

0 

0 

0 

0 

0 

0 

NOTE : E 


°E 


a 


E’ 


Average  forecast  error 

Standard  deviation  of  forecast  error 

Estimated  standard  deviation  of  error  of  forecast 
of  OST  mean. 
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TABLE  IV-7 


INVENTORY  AND  SERVICE-LEVEL  EFFECTS  OF  OST-FORECASTING  MODELS 

I 

DSU:  704th  Maintenance  Bn.  (CONUS) 

RIC-Group  I 

Cross-sectional  Sample  of  Items 
OST-FORECASTING  MODEL 


Item 


OSTN 


OSTM 


OSTT 


OSTNE 


OSTES 


PERFECT 
NIS 


No. 

I 

NIS 

I 

NIS 

I 

NIS 

I 

NIS 

I 

NIS 

I 

1 

27.3 

.30 

25.5 

.32 

27.6 

.29 

27.6 

.29 

27.9 

.28 

23.4 

.30 

2 

28.9 

.25 

27.5 

.28 

29.2 

.24 

29.2 

.24 

29.4 

.23 

26.0 

.24 

3 

77.7 

.10 

75.9 

.12 

78.0 

.10 

78.0 

.10 

78.3 

.10 

75.2 

.09 

4 

7.8 

.14 

7.6 

.15 

7.9 

.13 

7.9 

.13 

7.9 

.13 

7.5 

.12 

5 

24.2 

.15 

23.6 

.17 

24.4 

.15 

24.4 

.15 

24.5 

.15 

23.2 

.14 

6 

10.5 

.08 

10.3 

.09 

10.5 

.08 

10.5 

.08 

10.5 

.07 

10.3 

.08 

7 

53.3 

.01 

53.2 

.01 

53.3 

.01 

53.3 

.01 

53.4 

.01 

53.2 

.01 

8 

7.7 

.06 

7.6 

.06 

7.7 

.06 

7.7 

.06 

7.7 

.06 

7.6 

.06 

9 

15.1 

.10 

14.8 

.11 

15.1 

.09 

15.1 

.09 

15.1 

.09 

14.8 

.09 

10 

11.7 

.07 

11.6 

.07 

11.7 

.07 

11.7 

.07 

11.7 

.07 

11.6 

.07 

11 

4.1 

.27 

4.1 

.28 

4.1 

.27 

4.2 

.27 

4.2 

.27 

4.2 

.26 

12 

24.5 

.23 

23.5 

.26 

24.6 

.23 

24.5 

.23 

24.4 

.24 

23.7 

.24 

ample 

$5,522 

.27 

5,256 

.30 

5,567 

.27 

5,566 

.27 

5,607 

.26 

5,001 

.27 
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for  Item  No.  1 OSTM  has  the  lowest  average  Inventory  level,  I,  but  also 
the  highest  NIS  rate,  and  OSTES  has  the  lowest  NIS  rate  but  the  highest 
average  Inventory  level.  For  the  sample  as  a whole,  a similar  result  is 
true.  As  indicated  above,  the  technique  utilized  in  the  present  study  for 
resolving  this  ambiguity  is  to  adjust  the  inventory  control  rules  by  means 
of  the  safety  stock  coverage  period  until  the  NIS  rate  for  a given  model  and 
a given  sample  item  is  the  same  as  that  for  the  PERFECT  forecast.  When 
this  was  done  the  results  are  as  shown  in  Table  IV-8.  As  can  be  seen  the 
% increase  in  inventory  over  that  for  the  perfect  forecast  ranges  from  less 
than  0.1%  (for  Item  No.  11)  to  about  15%  (for  Item  No.  1).  The  differences 
in  the  standardized  inventory  requirements  for  the  various  models  are  generally 
quite  small  for  each  item.  For  the  entire  sample  the  increase  over  perfect 
forecast  inventory  requirements  ranges  from  9.8%  (for  OSTES)  to  10.9%  (for  OSTM). 
However,  it  is  possible  to  develop  a consistent  ranking  of  the  OST-forecasting 
models  from  these  data.  By  assigning  for  each  sample  item  a rank  number  from 
1 to  5 for  each  of  the  five  candidate  models,  it  is  possible  to  develop  a 
composite  ranking  number  over  all  sample  items  for  each  model.  This  result 
is  shown  in  Table  IV-9.  The  composite  ranking  yields  the  following  corres- 
ponding ranking  of  the  models: 

Rank  Model  Composite  Rank 


1 

OSTES 

2.04 

2 

OSTNE 

2.58 

3 

OSTN 

3.04 

4 

OSTT 

3.83 

5 

OSTM 

3.83 

Another  type  of  overall  ranking  can  be  obtained  by  considering  the  sample 
performance  results  given  in  Table  IV-8.  This  ranking  is: 
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TABLE  IV-8 


INVENTORY  EFFECTS  OF  OST-FORECASTING  MODELS 
DSU:  704th  Maintenance  Bn.  (CONUS) 

RIC-Group  I 

Cross-Sectional  Sample  of  Items 
I = Average  Inventory  Required  to  Give  the 


Same  NIS  Rate  as  the  Perfect  Forecast 


Y 

I 

NIS 

ITEM  NO. 

OSTN 

OSTM 

OSTT 

OSTNE 

OSTES 

PERFECT 

1 

27.0(15.2%) 

27.1(15.8%) 

27.0(15.3%) 

26.8(14.7%) 

26.7(14.3%) 

23.4 

.30 

2 

29.5(13.3) 

29.6(13.9) 

29.4(13.3) 

29.4(13.0) 

29.2(12.4) 

26.0 

.24 

3 

79. 6(  5.9) 

79.7(6.0) 

79. 1(  5.2) 

79. 3 ( 5.5) 

79. 2(  5.3) 

75.2 

.09 

4 

8.0(  6.5) 

7. 9(5. 7) 

8.0(  6.9) 

8. 0(  6.8) 

8. 0(  6.0) 

7.5 

.12 

5 

24. 6(  6.2) 

24.7(6.3) 

24. 7(  6.3) 

24. 6(  6.1) 

24. 5(  5.8) 

23.2 

.14 

6 

10. 5(  2.1) 

10.5(1.9) 

10. 6(  2.5) 

10. 5(  2.4) 

10. 5(  1.8) 

10.3 

.08 

7 

53. 4(  0.4) 

53.4(0.4) 

53. 3(  0.2) 

53. 3(  0.2) 

53. 4(  0.3) 

53.2 

.01 

8 

7. 7(  1.3) 

7. 7(1. 3) 

7. 7 ( 1.3) 

7 . 7 ( 1.3) 

7 . 7 ( 1.3) 

7.6 

.06 

9 

15. 1(  2.0) 

15.1(2.3) 

15. 1(  2.1) 

15. 1(  2.0) 

15. 0(  1.6) 

14.8 

.09 

10 

11. 7(  0.9) 

11.7(0.8) 

11. 7(  0.9) 

11. 7(  0.9) 

11. 7 ( 0.9) 

11.6 

.07 

11 

4 . 2 ( 0 ) 

4.3(1. 7) 

4 . 2 ( 0 ) 

4.2(  0 ) 

4 . 2 ( 0 ) 

4.2 

.26 

12 

24. 0(  1.3) 

24.1(1.8) 

24. 3(  2.3) 

24. 0(  1.3) 

24. 1(  1.9) 

23.7 

.24 

SAMPLE 

$5,528(10.5) 

$5,548(10.9) 

$5,521(10.4)  $5,511(10.2) 

$5,489 ( 9.8  ) 

$5p01 

.27 

* % increase  over  PERFECT  forecast  inventory  requirement 
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TABLE  IV-9 


INVENTORY  EFFFCTS  PERFORMANCE  RANKING  FOR  OST-FORECASTING  MODELS 

DSU:  704th  Maintenance  Bn. (CONUS) 
RIC-GROUP  I 

CROSS-SECTIONAL  ITEM  SAMPLE 
PERFORMANCE  RANK 


ITEM  NO. 

OSTN 

OSTM 

OSTT 

OSTNE 

OSTES 

1 

3 

5 

4 

2 

1 

2 

3.5 

5 

3.5 

2 

1 

3 

4 

5 

1 

3 

2 

4 

3 

1 

5 

4 

2 

5 

3 

4.5 

4.5 

2 

1 

6 

3 

2 

5 

4 

1 

7 

4.5 

4.5 

1.5 

1.5 

3 

8 

3 

3 

3 

3 

3 

9 

2.5 

5 

4 

2.5 

1 

10 

3 

3 

3 

3 

3 

11 

2.5 

5 

2.5 

2.5 

2.5 

12 

1.5 

3 

5 

1.5 

4 

Composite 

3.04 

3.83 

3.50 

2.58 

2.04 
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Rank 


Model 


% Inventory  Increase 
Over  Perfect  Forecast 


1 

OSTES 

9.8% 

(0) 

2 

OSTNE 

10.2 

(+0.4) 

3 

OSTT 

10.4 

(+0.6) 

4 

OSTN 

10.5 

(+0.7) 

5 

OSTM 

10.9 

(+1.1) 

This  is  essentially  the  same  as  the  above  composite  ranking,  with 
only  the  rankings  3 and  4 (OSTN  and  OSTT)  being  reversed. 

Although  it  is  possible  to  develop  such  rankings  for  the  relative 
performance  of  the  models,  the  difference  in  inventory  requirement  from 
the  highest  (OSTES)  to  the  lowest  (OSTM)  performance  models  is  only 
about  1%  of  the  perfect  forecast  inventory  requirement.  This  suggests 
that  implementation  considerations  will  play  an  important  role  in  the 
final  selection  of  the  most  appropriate  model.  These  factors  will  be 
considered  below,  following  the  analysis  of  performance  of  the  OST  fore- 
casting models  when  applied  to  the  European  DSU. 
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V.  RESULTS  FOR  THE  DSU:  703RD  MAINTENANCE  BN.  (EUROPE) 


A.  RIC-Groups 

The  basic  data  provided  by  the  LCA/LIF  for  this  DSU  were  read, 
converted  and  processed  to  yield  the  individual  RIC  OST  statistics  for 
both  ALOC  and  non-ALOC  requisitions.  These  results  are  shown  in  Table  V-l . 

In  general,  for  RICs  having  significant  numbers  of  non-ALOC  and  ALOC  requisitions,  che 
average  OSTs  (X)  for  ALOC  requisitions  are  seen  to  be  from  about  20  to  35 
days  less  than  those  for  non-ALOC  requisitions.  Since  the  transition  from 
non-ALOC  to  ALOC  occurring  during  the  time  span  of  the  LIF  data  is  now 
essentially  complete  and  ALOC  is  the  condition  of  interest  in  the  future, 
the  further  analysis  pertains  to  only  ALOC  requisitions.  Applying  the  cluster 
analysis  procedure  to  the  RIC  statistics  for  ALOC  requisitions  yields  the 


following  RIC-groups: 

N 

X 

°X 

RIC-Group 

I: 

AKZ, 

B14, 

GNO,  S9C 

820 

38.3. 

23.3 

RIC-Group 

II: 

S9I 

185 

32.4 

15.2 

II  II 

III: 

S9G 

107 

41.5 

14.0 

II  II 

IV: 

S9E 

60 

47.3 

19.8 

II  II 

V: 

A35 , 

B16 , 

MPB 

56 

63.2 

34.0 

II  II 

VI: 

A12 

24 

27.0 

9.1 

B.  RIC-Group  Sample 

The  major  RIC  Group  is 

seen 

to  be 

RIC 

Group  I. 

Consequently , 

a 205 

random  sample  of  OSTs  was  selected  from  this  RIC-Group  to  utilize  for  the 
simulation/evaluation  of  the  OST-forecasting  models  with  respect  to  fore- 
cast error.  This  OST  time  series  is  given  in  Appendix  F.  The  OST  statistics 
for  this  sample  versus  those  for  the  entire  RIC-Group  are: 

__N X ^X_ 

OST  Sample  205  37.8+1.7  24.6 

RIC-Group  I 820  38.3  + 0.8  23.3 

The  indicated  + quantities  are  the  standard  error  of  measurement  of 
the  mean  OST  for  a sample  size  of  N and  population  standard  deviation  o,^. 
These  statistics  indicate  that  the  sample  is  a good  representation  of  the 
RIC-Group . 
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TABLE  V-l 


» 


RIC  OST-STATISTICS 


DSU:  703rd  Maintenance  Bn. (EUROPE) 


RIC 

NON-ALOC 

ALOC 

N 

X 

(J 

X 

N 

X 

(T 

X 

AKZ 

1249 

59.7  days 

25.4  days 

613 

38.5  days 

24.5  days 

A12 

14 

60.9 

33.8 

24 

27.0 

9.1 

A35 

24 

66.9 

14.1 

10 

59.0 

24.7 

B14 

92 

70.4 

30.5 

61 

37.6 

18.8 

B16 

52 

60.7 

26.9 

45 

62.4 

34.3 

DDD 

4 

57.3 

2.5 

FHZ 

1 

73.0 

GNO 

46 

56.3 

12.5 

2 

39.0 

1.4 

MPB 

1 

141.0 

S9C 

85 

66.8 

24.9 

144 

37.5 

19.4 

S9E 

32 

62.8 

22.8 

60 

47.3 

19.8 

S9G 

75 

76.5 

25.0 

107 

41.5 

14.0 

S9I 

116 

55.9 

14.0 

185 

32.4 

15.2 

S9T 

13 

45.6 

10.2 
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c. 


Evaluation  Of  OST-Forecasting  Models  With  Respect  To  Forecast  Error 


As  in  the  case  of  the  CONUS  DSU,  the  error  performance  of  the  forecasting 
models  were  evaluated  by  applying  them  to  the  principal  RIC  Group  time 
series  by  means  of  the  OST-f orecasting  simulator/evaluator  program.  These 
simulations  represent  the  composite  performance  of  the  various  models  for 
all  group-forecast  items  in  the  RIC  Group.  As  such  they  constitute  a compre- 
hensive basis  for  performance  evaluation  of  the  models  with  respect  to 
forecast  error. 

1.  Parameter  Value  Adjustments 

As  a result  of  experience  gained  with  the  OST  forecasting  models  in 

the  CONUS  DSU  analysis,  some  adjustments  were  made  in  the  parameter  values 

of  the  models.  The  principal  such  adjustment  was  for  the  model  OSTES 

(adaptive  exponential  smoothing).  It  was  found  that  for  the  values  of  the 

time-period  response  parameters  (T  =180  days,  T =90  days)  and  the  error- 

X A 

limit  parameters  (e  =0.20,  e =0.05)  used,  the  performance  of  the  model 
max  min  ’ * • 

was  determined  primarily  by  the  value  of  e . , and  that  when  the  effect  of 

min 

the  time-period  response  parameters  was  nullified  by  setting  emax=em-^n= • 05 , 

the  performance  of  this  model  was  insignificantly  altered.  It  was  also 

found  that  for  the  ALOC  RIC-Group  I OST  time  series  for  this  DSU,  the  value 

emin=emax=^' ®ave  a slight  but  statistically  significant  improvement  in 

forecast  error  performance.  This  value  was  used  in  the  evaluation.  This 

is  one  of  the  modes  in  which  the  OSTES  model  was  designed  to  be  used.  It 

results  in  a much  simpler  model  to  apply  since  only  the  single  parameter 

emax*emin  must  specified-  The  model  then  automatically  adapts  to  any 

particular  OST  time  series  to  meet  the  specified  error  value.  Consequently, 

this  version  of  the  OSTES  model  was  used  in  the  present  evaluation. 

It  was  also  found  that  the  poor  performance  of  the  model  OSTDES  (adaptive 

double  exponential  smoothing)  was  due  to  the  use  of  the  tracking  signal  for 

determining  the  value  of  the  smoothing  constant  to  use  in  the  procedure.  The 

smoothing  constant  limits,  a , and  a , used  in  the  procedure  to  constrain 

min  max  r 

the  calculated  value  may  be  used  to  eliminate  the  adaptive  feature  of  this 

model  by  setting  a . = a . In  an  effort  to  improve  the  performance  of 

tnin  infix 

this  model,  these  two  parameter  values  were  set  at  0.05. 
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Another  parameter  adjustment  that  was  made  was  in  the  model  OSTT  (average 
of  observations  occurring  in  the  last  time  period  T) . As  discussed  earlier, 
it  is  necessary  to  adjust  the  time  period  T for  this  model  to  take  into  account 
the  differing  rates  at  which  OSTS  occur  for  different  RIC-group  or  individual 
item  OST  time  series.  In  the  present  case  the  total  number  of  OSTS  (205)  is 
essentially  the  same  as  that  (202)  for  the  CONUS  DSU,  however,  the  time  span 
for  ALOC  requisitions  in  the  present  case  is  only  about  one-half  that  for  the 
former  DSU.  Consequently,  the  corresponding  value  of  the  parameter  T in  this 
model  was  taken  to  be  T = 90  days. 

As  in  the  case  of  OSTES,  it  was  found  that  for  OSTNE  the  use  of  a value 
of  0.03  rather  than  0.05  for  the  specified  error  parameter  resulted  in  a slight 
but  statistically  significant  improvement  in  forecast  error  performance. 
Consequently,  this  value  was  used  for  this  model. 

For  OSTN  it  was  found  that  the  use  of  N = 48  rather  than  N = 24  resulted 
in  some  improvement  in  forecast  error  performance,  so  this  parameter  value 
was  used  for  this  model  in  the  evaluation. 

2,  Evaluation  Results 

The  results  of  applying  the  OST-forecasting  models  to  the  sampled 
RIC-Group  I OST  time  series  are  given  in  Table  V-2.  It  is  seen  that  the 
same  models  have  poor  forecast  error  performance  as  in  the  case  above  for 
the  CONUS  DSU;  namely,  OSTMO,  OSTEDES , and  OSTR.  Thus  the  candidate  models 
for  further  evaluation  with  respect  to  inventory  effects  are,  as  before: 

OSTN 

OSTM 

OSTT 

OSTNE 

OSTES 

The  error  statistics  for  these  models  generated  by  the  simulation  runs  are 
given  in  Table  V-3.  These  are  the  forecast  error  parameters  to  be  used  in 
evaluating  the  inventory  effect  of  the  models  on  the  group-forecast  items  of  the 
RIC-Group . 
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TABLE  V-2 


EVALUATION  OF  OST-FORECASTING  MODELS  WITH  RESPECT  TO  FORECAST  ERROR 

DSU:  703rd  Maintenance  Bn.  (EUROPE) 

RIC-Group  I (ALOC) 

205-OST  SAMPLE 


OST-Forecasting 
Model 

OSTN 

OSTM 

OSTMO 

OSTT 

OSTNE 

OSTES 

OSTDES 

OSTR 


RMSE 

12.64+  .13  days 

12.53 

14.30+  .02 

12.56 

14.20 

13.83 

15.26 

18.83+  .45 


RMSE' 


3.60+ 

. 16  days 

3.05+ 

.07 

5.93+ 

.06 

3.12+ 

.17 

3.92+ 

.17 

6.78+ 

.11 

6.60+ 

.20 

7.15+ 

.33 
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TABLE  V-3 


FORECAST  ERROR  PARAMETERS  FOR  OST-FORECAST  MODELS 

DSU:  703rd  Maintenance  Bn.  (EUROPE) 
RIC-Group  I (ALOC) 

205-OST  SAMPLE 


OST 

Forecast 

Models 

E 

°E 

V 

OSTN 

3.15  days 

12.24  days 

1.71  days 

OSTM 

-1.39 

12.46 

2.44 

OSTT 

2.90 

12.22 

2.27 

OSTNE 

4.12 

13.69 

1.12 

OSTES 

7.05 

11.90 

1.20 

PERFECT 

0 

0 

0 

* 
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D.  Evaluation  Of  OST-Forecasting  Models  With  Respect  To  Inventory  Effects 


1.  Cross-Sectional  Sample  of  Items 

In  order  to  further  evaluate  the  most  promising  OST-forecasting  models 
with  respect  to  inventory  effects  it  was  necessary  to  select  a cross-sectional 
sample  of  items  for  the  DSU.  Such  a sample  was  chosen  from  the  principal 
RIC  Group  (I)  for  this  DSU.  The  item  parameters  for  this  sample  are  shown 
in  Table  V-4.  Unit  prices  range  from  $2  to  $43,  demand  rates  from  $ll/year  to 
$1490/year  and  $185/year  to  $3500/year.  The  parameter  values  given  in 
Table  V-4,  together  with  the  forecast  error  parameters  given  in  Table  V-3, 
constitute  the  input  data  required  for  the  inventory  effects  evaluation  of 
the  OST-forecasting  models  by  means  of  the  analytic  inventory  control  evaluator 
program. 

2.  Evaluation  Results 

The  results  of  this  evaluation  are  given  in  Table  V-5.  The  performance 
measures  given  in  this  table  are  the  expected  inventory  level  (I)  and  the 
not-in-stock  rate  (NIS)  for  each  sample  item  and  the  entire  sample,  resulting 
from  the  specified  forecast  error  statistics  and  sample  item  parameters.  As 
in  the  case  of  the  CONUS  DSU,  there  is  some  difficulty  in  determining  the 
relative  quality  of  performance  of  the  different  models  based  on  these  two 
measures.  This  is  because  it  is  desirable  to  have  both  low  inventories  (I) 
and  low  not-in-stock  rate  (NIS)  yet  these  quantities  are  reciprocally  related 
so  that  lower  inventory  tends  to  be  associated  with  a higher  NIS  rate.  For 
example,  for  Item  11  OSTM  is  more  favorable  than  OSTN  with  respect  to  I 
(246  versus  262)  but  it  also  has  a higher  NIS  rate  (0.10  versus  0.07).  So 
the  question  arises  as  to  whether  the  increase  in  NIS  rate  more  or  less  than 
compensates  for  the  decrease  in  inventory.  As  indicated  in  the  case  of  the 
CONUS  DSU,  this  ambiguity  is  resolved  in  the  present  study  by  artificially 
adjusting  the  specified  safety  stock  coverage  period  (15  days  for  the  European 
DSU)  until  the  NIS  rate  is  the  same  as  that  for  the  perfect  forecast,  then 
the  increase  in  required  inventory  over  that  for  the  perfect  forecast  is  taken 
as  the  single  performance  measure  for  evaluating  the  various  OST-forecast 
models.  The  results  of  performing  this  procedure  for  the  sample  items  and 
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CROSS-SECTIONAL  SAMPLE  OF  ITEMS  FOR  EVALUATING  INVENTORY  EFFECTS  OF  OST-FORECASTING  MODELS 
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Obtained  from  the  DSU  Demand  History  Report  (Class  IX  Repair  Parts-Common) 


TABLE  V-5 


INVENTORY  AND  SERVICE  LEVEL  EFFECTS  OF  OST-FORECASTING  MODELS 
DSU:  703rd  Maintenance  Bn.  (EUROPE) 

RIC-Group  I:  OST-Forecast  Error  Statistics 
Cross-Sectional  Item  Sample 


ITEM 

NUMBER 

OST- 

FORECAST 

MODEL 

OSTN 

OSTM 

OSTT 

OSTNE 

OSTES 

PERFECT 

1 

I = 

4.3 

units  4.2 

4.3 

4.4 

4.4 

4.3  \ 

NIS  = 

0.18 

0.19 

0.18 

0.17 

0.16 

0.18 

2 

I = 

13.4 

12.9 

13.3 

13.5 

13.8 

13.0 

NIS  = 

0.11 

0.13 

0.11 

0.11 

0.09 

0.11 

3 

I = 

77.4 

73.9 

77.2 

78.2 

80.5 

74.7 

NIS  - 

0.03 

0.05 

0.03 

0.03 

0.02 

0.02 

4 

I = 

14.5 

PH 

14.4 

14.7 

PH 

13.8 

NIS  - 

0.14 

Kill 

0.14 

0.14 

BeXiI 

0.14 

5 

I - 

23.7 

23.1 

23.6 

23.8 

24.2 

23.2 

NIS  = 

KiWiU 

0.08 

0.06 

0.06 

0.05 

0.06 

6 

I - 

102.2 

95.1 

101.8 

103.9 

108.5 

96.8 

NIS  » 

0.03 

0.05 

0.03 

0.03 

0.01 

0.004 

7 

I =* 

8.2 

7.9 

8.2 

8.3 

8.6 

7.9 

NIS  = 

0.08 

0.10 

0.08 

0.08 

0.06 

0.07 

8 

I - 

98.9 

■61 

98.6 

100.0 

103.0 

95.4 

NIS  - 

0.02 

0.02 

0.02 

0.01 

0.004 

9 

I - 

33.5 

31.6 

33.4 

33.9 

35.1 

31.9 

NIS  - 

0.07 

0.10 

0.07 

0.07 

0.05 

0.06 

10 

I - 

10.6 

■ 

10.6 

10.8 

10.4 

NIS  - 

0.09 

■'H'M 

0.08 

0.10 

11 

I - 

262.4 

mm 

261.4 

266.5 

277.2 

248.4 

NIS  - 

0.07 

0.07 

0.07 

0.05 

0.05 

12 

I - 

11.8 

11.5 

11.8 

11.9 

12.1 

11.6 

NIS  - 

0.04 

0.06 

0.04 

0.04 

0.03 

0.04 

SAMPLE 

I 

$3,951 

$3,750 

$3,940 

$3,999 

$4,129 

$3,790 

NIS  - 

0.07 

0.10 

0.07 

0.07 

0.05 

0.06 
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for  Che  entire  sample  are  given  in  Table  V-6.  The  table  also  gives  the  % 
increase  in  inventory  requirements  over  that  for  the  perfect  forecast  for 
each  model  for  each  sample  item.  These  increases  are  seen  to  be  generally 
higher  for  the  higher  demand  (or  I)  items.  For  example,  for  Item  2,  having 
a perfect  forecast  inventory  requirement  of  13  units,  these  increases  range 
from  about  2 to  3%  for  the  different  models.  On  the  other  hand,  for  Item  6, 
having  an  inventory  requirement  of  97  units,  the  increases  range  from  about 
26  to  32%.  This  indicates  that  the  major  effect  of  forecast  error  tends  to 
occur  for  high  inventory  items,  which  account  for  a large  share  of  the  total 
inventory  held  by  a DSU. 

a.  RIC-Group  Ranking  of  OST-Forecast  Models 

For  the  entire  cross-sectional  sample  of  items,  the  increase  in 
inventory  value  over  the  perfect  forecast  value  ranges  between  6.7  and  8.8% 
for  the  candidate  models. 

The  ranking  of  the  models  based  on  the  entire  sample  is : 


Rank 

OST-Forecast  Model 

% Inventory  Increase 
Over  Perfect  Forecas 

1 

OSTES 

6.73%  (0) 

2 

OSTN 

7.31  (+.58) 

3 

OSTT 

7.36  (+.63) 

4 

OSTM 

7.66  (+.93) 

5 

OSTNE 

8.81  (+2.08) 

b.  Individual  Item  Ranking  of  OST-Forecast  Models 

It  is  possible  to  obtain  a composite  ranking  over  the  individual 
items  of  the  sample  by  ranking  the  models  for  each  item  and  computing  an 


average  rank. 

is : 

Rank 

This  result  is  shown  in  Table  V-7. 

OST-Forecast  Model 

The  composite  ranking 

Composite  Rank 

1 

OSTES 

1.17 

2.5 

OSTN 

2.50 

2.5 

OSTT 

2.50 

4 

OSTM 

3.83 

5 

OSTNE 

5.00 
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TABLE  V-6 


INVENTORY  EFFECTS  OF  OST-FORECASTING  MODELS 
DSU:  703rd  Maintenance  Bn.  (EUROPE) 

RIC-Group  I (ALOC) 

Cross-Sectional  Sample  of  Items 

I = Average  Inventory  Required  to  Give  the  Same 
NIS  Rate  as  the  Perfect  Forecast 


ITEM 

NUMBER 

OST-FORECASTING  MODEL 

I 

I 

NIS 

OSTN 

OSTM 

OSTT 

OSTNE 

OSTES 

PERFECT 

1 

A.  300 

A.30A 

A. 311 

A.  300 

A.  30 

.18 

( 0.0%)  * 

(0.1%) 

(0.%) 

(0.25%) 

(0%) 

2 

13.33 

13.31 

13.27 

13. A0 

13.25 

13.00 

.11 

(2.56) 

(2.38) 

(2.05) 

(3.09) 

(1.91) 

3 

81.9 

82.0 

81.7 

82.9 

81.6 

7A.70 

.02 

(9.60) 

(9.70) 

(9.37) 

(10.92) 

(9.20) 

A 

1A.A3 

1A.A9 

1A.39 

1A.57 

1A.39 

13.80 

• 1A 

(A. 58) 

(A. 97) 

(A. 25) 

(5.56) 

(A. 27) 

5 

23.65 

23.62 

23.59 

BUB 

mm 

23.20 

.06 

(1.9A) 

(1.81 

(1.67) 

BmUl 

■(S»l 

6 

123.32 

12A.A5 

123.57 

127.52 

121. 9 A 

96.80 

.0A 

(27. A0) 

(28.57) 

(27.65) 

(31.73) 

(25.97) 

7 

8.30 

8.36 

8.31 

8.38 

8.28 

7.90 

.07 

(5.82) 

(5.15) 

( 6.03) 

(A. 77) 

8 

109.61 

110. A2 

109.85 

112.73 

108.92 

95. A0 

. 00A 

(1A.89) 

(15.75) 

(15. 1A) 

(18.17) 

(1A.18) 

9 

3A.A5 

3A.57 

3A.A8 

3A.97 

3A.20 

31.90 

.06 

(8.00) 

(8.36) 

(8.09) 

(9.63 

(7.21) 

10 

10.51 

10.53 

10.52 

10.53 

10.  A8 

10. A0 

.10 

(1.02) 

(1.2A) 

(1.18) 

(1.29) 

0.76) 

11 

27A.26 

275.52 

27A.A2 

279. A5 

272.27 

2A8.A0 

.05 

(10. Al) 

(10.92) 

(10. A7) 

(12.50) 

( 9.61) 

12 

11.90 

11.98 

11.93 

12.00 

11.90 

11.60 

.0A 

(2.61) 

(3.31) 

(2.82) 

(3.A8) 

(2.59) 

SAMPLE 

$A,067 

$A ,080 

$A , 069 

$A , 12A 

$A,0A5 

$3,790 

.06 

(7.31) 

(7.66) 

(7.36) 

8.81) 

(6.73) 

* % increase  over  PERFECT  forecast  inventory  requirement. 
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TABLE  V-7 


INDIVIDUAL  ITEM  AND  COMPOSITE  RANKING  OF  OST-FORECASTING 
MODELS  WITH  RESPECT  TO  INVENTORY  EFFECTS 

DSU:  703rd  Maintenance  Bn.  (EUROPE  ) 

RIC-Group  I ( ALOC  ) 

Cross-Sectional  Item  Sample 

PERFORMANCE  RANKING 

Item  OST-FORECASTING  MODEL 

Number  OSTN  OSTM  OSTT  OSTNE  OSTES 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 


2 

4 

3 

3 

4 
2 
2 
2 
2 
2 
2 
2 


4 

3 

4 
4 

3 

4 
4 
4 
4 
4 
4 
4 


2 

2 

2 

1 

2 

3 

3 

3 

3 

3 

3 

3 


5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 


2 

1 

1 

2 

1 

1 

1 

1 

1 

1 

1 

1 


COMPOSITE  2.50  3.83  2.50  5.00  1.17 
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c.  Overall  Evaluation 


Thus  it  is  seen  that  the  rankings  of  the  OST-forecast  models  with 
respect  to  inventory  effects,  for  the  sample  as  a whole  and  for  the  individual 
items  of  the  sample,  are  essentially  the  same  for  this  DSU-being  OSTES , OSTN, 
OSTT,  OSTM,  OSTNE.  These  are  the  same  top-5-models  indicated  by  the  results 
for  the  CONUS  DSU,  and,  except  for  OSTNE,  the  same  ranking  as  previously. 

Again,  as  in  the  case  of  the  CONUS  DSU,  the  differences  between  the 
performances  of  the  OST  forecast  models  is  not  great,  ranging  to  a maximum  of 
about  2%  perfect-forecast  inventory  levels,  from  OSTES  (6.7%  increase)  to 
OSTNE  (8.8%  increase).  Consequently,  the  decision  as  to  the  most  appropriate 
model  to  use  will  depend  strongly  on  implementation  considerations , to  be 
discussed  below. 
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VI.  IMPROVED  OST-FORECASTINC  ERROR  MEASURE 


Decompositon  of  Inventory  Effects 


The  OST-forecast  errors  are  reflected  by  three  basic  error  statistics: 


E = the  average  error  of  the  forecast  from  actual  OSTs 

= the  average  error  of  the  forecast  from  true  OST  mean 

a_  = the  standard  deviation  of  the  forecast  error  from  actual 

E 

OSTs 

a,, ' = the  standard  deviation  of  the  forecast  error  from  the 

E 

OST  mean 


The  inventory  and  service  level  effects  of  OST  forecast  errors  may  be 
decomposed  into  the  two  siparate  effects: 

1)  An  effect  due  to  deviations  ( E ' ) of  the  forecast  from 
the  OST  mean  (summarized  by  E and  o^i  ) 

2)  An  effect  due  to  the  deviations  of  the  forecast  from  actual  OSTs 
(summarized  by  E and  o^ ) 

The  first  effect  results  from  the  use  of  the  OST-forecast  in  the 
calculation  of  the  reorder  point  for  an  item.  Letting 


ROP  = the  reorder  point 

D = the  forecasted  demand  rate 
L ■ the  true  OST  mean 
S - the  safety  stock  coverage  period 

A 

X * the  forecasted  OST 

then 

A 

ROP  - D . (X  + S) 

- 5 . (L  + S + X - L) 

- 5 . (L  + S + E') 


This  shows  explicitly  h-">w  the  OST  forecast  errors,  E'  , from  true  OST 
mean  affect  the  inventory  control  rules.  The  component  of  average  inventory 
associated  with  the  reorder  point  is 
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that  this  measure  of  forecast  error,  rather  than 


KMSE 


or 

RMSE'= 

would  be  a more  appropriate  indicator  of  the  inventory  effects  of  OST- 
forecast  error. 


The  weak  effect  of  a , for  the  European  DSU  is  shown  in  Table  VI-1.  It 
E 

can  be  seen  that  for  all  sample  items  the  average  required  inventories 

and  corresponding  service-levels  are  almost  identical  for  o ,=  0 as  for 

E 

the  values  used  in  the  above  evaluations. 

C.  Most  Important  Error  Parameter 

That  the  single  forecast  error  parameter  o„  is  a reliable  indicator 

L 

for  the  quality  of  performance  of  an  OST-forecasting  model  is  illustrated 

by  the  ranking  of  models  that  is  given  by  o for  the  European  DSU  (see 

E 

Table  V-3) : 


Entire-Sample  Ranking 

Composite  Individual  Item  Ranking 

o„-Ranking 

t 

fV 

OSTES 

OSTES 

OSTES 

(11.90) 

OSTN 

/ostn\ 

OSTT 

(12.22) 

OSTT 

yOSTT J 

OSTN 

(12.24) 

OSTM 

OSTM 

OSTM 

(12.46) 

OSTNE 

OSTNE 

OSTNE 

(13.69) 

It  is  seen  that  there  is  essentially  perfect  correlation  between  the  previous 

ranking  and  that  based  on  o . Similarly,  for  the  CONUS  DSU,  the  comparative 

E 

rankings  are: 

Entire-Sample  Ranking  Composite  Individual  Item  Ranking  ^E  ^an'c  ^ ^E^ 


OSTES 

OSTES 

OSTES 

(14.1) 

OSTNE 

OSTNE 

OSTNE 

(14.4) 

OSTT 

OSTN 

OSTT 

(14.6) 

OSTN 

OSTT 

OSTN 

(14.7) 

OSTM 

OSTM 

OSTM 

(15.0) 

Again 

given 

the  correlation  between  the  previous  inventory  effect 
by  oE  (for  the  RIC-Croup)  is  essentialy  perfect. 

ranking  and 

that 
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TABLE  VI- 1 


EFFECT  OF  a . ON  OST-FORECASTING  PERFORMANCE 
E 

DSU : 703rd  Maintenance  Bn.  ( EUROPE  ) 

RIC-Group  I 

Cross-Sectional  Sample  of  Items 

Model : OSTN 
S = 15  days 


; Average  Inventory 

Requirement  NIS-Rate 


Item 

Number 

°E ' * ° 

R.q 

H 

O 

°E'  * 0 

°E ' - 0 

i 

1 

4.341 

4.341 

.1774 

.1774 

2 

13.366 

13.365 

.1076 

.1074 

3 

77.397 

77.393 

.0285 

.0281 

4 

14.467 

14.465 

.1397 

.1394 

5 

23.672 

23.672 

.0634 

.0633 

6 

102.237 

102.228 

.0276 

.0270 

7 

8.240 

8.239 

.0760 

.0756 

8 

98.903 

98.899 

.0188 

.0184 

9 

33.464 

33.460 

.0721 

.0717 

10 

10.577 

10.577 

.0914 

.0913 

jn 

262.364 

262.328 

.0704 

.0698 

i 12 

11.831 

11.830 

.0407 

.0406 

1 

, 

These  results  give  a strong  indication  that  for  the  purpose  of  assessing 
the  inventory  control  effects  of  OST-forecast  error,  the  standard  deviation 
of  the  forecast  error  is  a much  more  indicative  measure  of  the  inventory  effects 
of  forecast  error  than  is  the  RMSE,  used  in  the  initial  evaluation  of  OST- 
forecasting  models  in  this  study.  This  measure  eliminates  the  forecast 
bias  (average  forecast  error)  from  consideration  and  reflects  only  the  variance 
of  the  forecast  error  about  this  bias. 
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VII.  IMPLEMENTATION  CONSIDERATIONS  FOR  OST-FORECASTING  MODELS 


The  above  results  indicate  that  although  it  is  possible  to  obtain  a 
clear  ranking  of  the  OST-forecasting  models,  the  differences  in  performance 
among  the  models  is  not  great,  on  the  order  of  1 to  2%  saving  in  total  in- 
ventory investment  value.  The  model  that  performed  uniformly  best  for  both 
DSUs  used  in  the  study  and  for  both  group-forecast  and  item-forecast  items, 
was  OSTES-the  adaptive  exponential  smoothing  model.  However,  if  there  are 
significant  difficulties  in  applying  this  model  in  actual  practice,  compared 
to  any  other  of  four  screend  OST-forecast  models  (OSTN,  OSTM,  OSTT,  OSTNE), 
then  it  might  well  be  that  one  of  these  other  models  should  be  selected  as 
the  best  overall  choice  of  OST-forecast  model.  Consequently,  it  is  necessary 
to  consider  the  implementation  aspects  of  the  candidate  models. 

A.  OSTN  Model 

The  relative  performance  among  the  OST-forecast  models  can  be  indicated 
by  the  equivalent  % inventory  increase  over  that  required  for  the  OSTES  model  - 
the  one  having  the  least  % inventory  increase  over  perfect-forecast.  For 
OSTN  this  inventory  increase  is  about  0.7%  for  the  CONUS  DSU  and  0.6%  for  the 
European  DSU  ( see  Table  IV-8  and  Table  V-6,  respectively,  for  the  entire 
sample  results).  The  required  number  of  OST  observations  for  this  model  is 
in  the  range  from  about  24  to  48.  This  contrasts  with  the  number  6 for  the 
current  system  (which  utilizes  the  OSTN  model  with  N = 6) . Thus  the  use  of 
the  OSTN  model  would  require  a substantial  expansion  of  the  fixed-size  OST 
data  base  for  storing  historical  OST  observations.  Also  there  would  be  a con- 
siderable problem  of  initialization  or  build-up  of  the  data  base  for  item- 
forecast  items  to  that  required  for  this  model.  Slower  moving  items  would 
require  several  years  of  OST  data.  Even  items  ordered  monthly  would  require 
2 to  4 years  of  data.  In  addition,  to  the  unavailability  or  incompleteness  of 
such  data,  there  would  be  the  question  of  the  relevance  of  OST  data  in  the 
considerably  distant  past.  These  factors  pose  serious  problems  for  the 
implementation  of  this  model  that  mitigate  against  its  selection. 
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B. 


OSTM  Model 


This  model  would  require  about  1%  more  inventory  than  OSTES  (1.1%  for 
the  CONUS  DSU  and  0.9%  for  the  European  DSU).  It  would  require  a fixed-size 
data  base  of  about  25  OST  observations,  and  thus  would  tend  to  have  imple- 
mentation objections  similar  to  those  discussed  above  for  OSTN. 

C.  OSTT  Model 

This  model  would  require  about  0.6%  increase  in  inventory  (for  both  the 
CONUS  and  European  DSUs)  over  that  required  for  OSTES.  Since  the  number  of 
OST  observations  required  by  this  model  is  the  number  falling  in  a specified 
time  period,  the  OST  data  base  is  variable,  so  that  allowance  must  be  made 
for  some  maximum  number  of  observations.  For  the  CONUS  DSU  the  number  of  OST 
observations  required  in  the  simulation  for  this  model  ranged  from  26  to  69. 

For  the  European  DSU  the  number  of  required  observations  ranged  from  23  to  57. 
Consequently,  implementation  of  this  model  would  require  a quite  large  allocation 
for  storage  of  the  requisite  number  of  OSTs.  In  addition,  the  large  maximum 
number  of  required  observations  would  raise  initialization,  build-up,  and 
relevance  problems  similar  to  those  discussed  above  for  OSTN  and  OSTM. 
Consequently,  the  difficulties  associated  with  the  implementation  of  this 
model  are  compounded  by  not  only  these  latter  problems,  but  also  the  question 
of  the  provision  of  maximum  storage  space  for  OST  observations. 

D.  OSTNE  Model 

The  performance  of  this  model  was  somewhat  variable  for  the  two  DSUs, 
varying  from  a requirement  of  0.4%  increase  of  inventory  over  OSTES  for  the 
CONUS  DSU  to  one  of  2%  increase  for  the  European  DSU.  This  model  also,  like 
OSTT,  requires  a variable  number  of  OST  observations  for  calculating  the  OST 
forecast  - this  number  being  that  required  to  give  a specified  error  of  the 
forecast  of  the  OST  mean.  For  the  CONUS  DSU  simulation  this  number  ranged 
from  23  to  67  observations  and  for  the  European  DSU  from  37  to  73  observations. 
Consequently,  the  same  observations  apply  to  this  model  as  for  the  above 
variable  size  OST  data  base  requirement  for  OSTT. 
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E. 


OSTES  Model 


This  model  performed  uniformly  (slightly)  best  for  both  DSUs.  It 
requires  no  actual  historical  OST  observations,  but  only  the  summarization 
of  all  past  observations  by  means  of  the  single  quantity,  the  most  recent 
forecast  value.  This  value  is  then  used,  together  with  the  next  OST  obser- 
vation to  generate  the  next  OST  forecast.  In  order  to  perform  the  automatic 
calculation  of  the  smoothing  constant  used  in  the  model,  it  is  necessary  to  utilize 
not  only  the  most  recent  value  of  the  OST  forecast,  but  also  the  standard 
deviation  (o  ) of  the  forecast  error.  For  the  simulation  in  the  present  study, 
the  values  of  were  calculated  from  the  beginning  of  the -simulation.  In 
actual  practice  this  could  be  accomplished  mere  simply  and  in  a more  adaptive 
manner  by  obtaining  this  value  by  smoothing.  It  is  shown  in  Appendix  G how  to 
accomplish  this.  It  requires  the  maintenance  of  the  two  error  measures  E 

and  a_. 

E 

Thus  the  data  base  for  each  item  or  item-group  consists,  for  this  model, 

A 

of  only  the  three  elements:  the  current  OST  forecast  (X),  the  current  OST 

forecast  bias,  E , and  the  current  standard  deviation  (o  ) of  the  forecast  error. 

E 

Another  factor  simplifying  the  application  of  OSTES  is  the  finding  in  this 

study  that  the  use  of  the  response  time-period  parameters  of  the  model  T and  T , 

X A 

contributed  very  little  to  the  quality  of  the  forecasts  over  that  resulting 
from  nullifying  the  effect  of  these  parameters  by  setting  e , » e » e the 
specified  error  of  the  forecast  of  OST  mean.  This  simplifies  the  OSTES  model 
considerably,  requiring  only  the  single  parameter  e for  application.  The 
appropriate  values  of  the  smoothing  constant,  a,  are  then  automatically  cal- 
culated from  item  to  item,  group  to  group,  and  over  time  for  individual  items 
or  groups  by  the  adaptive  procedure  incorporated  into  the  OSTES  model.  This 
feature  answers  the  objection  sometimes  expressed  against  exponential  smoothing 
techniques ;namely  how  is  one  to  specify  and  maintain  the  appropriate  values  of 
the  smoothing  constants  for  many  thousands  of  items  over  long  periods  of  time? 

In  the  OSTES  model  it  is  required  to  specify  only  the  desired  standard  error,  e, 
of  the  forecast  of  the  OST  mean.  This  is  policy-type  criterion  that  can  be 
specified  quite  generally  for  broad  classes  of  items  - or  all  items.  Then  the 
OSTES  procedure  automatically  adjusts  to  the  error  statistics  for  different  items, 
groups,  and  times. 
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This  simplified  modification  of  the  original  OSTES  previously 
reported  in  the  memorandum  "OST-Forecasting  and  Evaluating  Models", 

18  August,  1977,  is  given  in  Appendix  G. 

Hence  it  is  concluded  on  the  basis  of  both  the  performance  of  the 
OSTES  model  and  the  simplicityof  its  implementation,  that(of  the  OST- 
forecast  models  evaluated  in  this  study)  the  OSTES  model  is  clearly  to 
be  recommended. 
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VIII.  UPDATING  OF  THE  REQUISITIONING  OBJECTIVE 


The  basic  purpose  for  which  demand  and  OST  forecasts  are  made  is  for 
use  in  calculating  the  item  inventory  control  decision  levels  (reorder  point 
ROP  and  requisitioning  objective  RO) . These  control  levels  are  given  by 

ROP  - 5 (X  + S) 

RO  = ROP  + Q 


where 


D 

A 

X 

s 

Q 


the  forecasted  item  demand  rate 
the  forecasted  item  OST 
the  safety-stock  coverage  period 
4. 75^D/c 

c = the  item  cost  (price) 


In  principle,  the  best  values  of  ROP  and  RO  result  from  using  the  best 

A 

available  values  of  the  demand  and  OST  forecast,  D and  X.  The  best  estimates 
for  these  forecast  values  at  any  time  are  those  most  recently  calculated. 

Thus  the  best  values  of  ROP  and  RO  result  from  updating  their  values  whenever 

— A 

either  D of  X are  updated.  This  is  particularly  true  for  ROP  which  controls 
the  timing  of  replenistoent  requisitions.  If  the  demand  rate  or  OSTs  change  but 
ROP  is  not  updated,  then  requisitions  will  not  be  triggered  in  accordance 
with  current  conditions.  This  will  result  in  excess  inventories  in  case  triggering 
is  too  early  (i.e.  if  demand  and/or  OST  are  decreasing)  and  excess  stock  shortages 
if  triggering  is  too  late  (i.e.  demand  and/or  OST  are  increasing). 

Present  ROP/RO  updating  policy  is  to  update  both  ROP  and  RO  whenever  a 
requisition  is  triggered  - that  is,  whenever  the  inventory  position  of  an  item 
falls  to  or  below  the  previously  updated  ROP,  calculated  at  the  time  of  the 
preceding  requisition.  The  updating  of  the  RO  at  this  time  does  indeed  ap- 
propriately adjust  the  requisition  quantity  to  reflect  current  conditions.  However, 
this  procedure  does  not  allow  any  such  compensating  adjustment  in  the  timing  of 
the  requisition  if  the  requisition  is  triggered,  based  on  the  ROP  calculated  at 
the  previous  requisition  update,  too  early  or  too  late  relative  to  the  currently 
updated  ROP.  Then  the  requisition  is  still  placed  at  the  present  time  and  the 
detrimental  consequences  of  this  mistiming  will  result.  To  Illustrate  this 
effect,  consider  an  item  whose  demand  and  OST  forecasts  at  the  time  of  the 
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last  requisition  were 


D = 10  units/month 

X = 35  days 

Suppose  also  that  the  safety  stock  period  is 
S =5  days 

The  ROP  calculated  at  the  time  of  the  previous  update  would  be 
ROP  = 10(35  + 5 ) / 30  - 13  units 

This  value  of  ROP  is  then  used  until  the  next  requisition  is  triggered. 

Suppose  that  when  this  occurs  the  current  forecasts  are 

D =12  units/month 
X = 37  days 

so  that  the  updated  ROP  at  this  time  is 

ROP  = 13 (42) /30  = 18  units. 

Thus  the  requisition  which  was  triggered  at  an  inventory  position  of  13 
should  have  been  triggered  at  a level  of  18.  With  the  current  demand  rate 
of  13/month,  this  translates  into  a postponement  of  about  12  days  in  placing 
the  requisition.  This  is,  in  effect,  equivalent  to  adding  12  days  to  the 
OST  for  the  current  requisition.  The  result  would  be  a substantial  increase 
in  the  likelihood  and  number  of  expected  shortages.  The  fact  that  an  updated 
RO  is  calculated  at  this  time  would  in  no  way  mitigate  the  consequences  of 
the  delayed  placing  of  the  requisition.  If  the  current  values  of  the  demand 
and  OST  forecast  are  less  than  those  at  the  time  of  the  last  requisition,  say 

D =8  units/month 
X = 32  days 

then  the  currently  updated  values  of  the  ROP  would  be 
ROP  = 8 (37)30  = 10  units. 

The  requisition  would  then  have  been  triggered  when  the  inventory  was  3 units 
higher  (or  11  days  earlier)  than  necessary.  If  the  unit  price  of  the  item 
is  $2,  then 

Q = 4.75  V§/2  = 9.5  units 


73 


This  compares  with  Q = 10.6  for  the  previous  value  of  Q.  Thus  the 
inventory  is  3 units  too  high  due  to  use  of  the  previous  ROP,  but  the  Q 
is  reduced  by  only  about  1 unit  and  the  corresponding  average  inventory  reduction 
is  only  1/2  this  amount,  consequently,  an  excess  inventory  of  about  2.5  units 
would  occur  in  this  case. 

These  examples  illustrate  the  potential  importance  of  updating  the  ROP 
during  the  interim  between  requisitions.  Although  it  is  not  necessary  to  update 
the  RO  until  a requisition  is  triggered,  there  is  essentially  no  increase  in 
cost,  time,  or  effort  in  a computerized  system  to  calculating  the  current  economic 
order  quantity  Q from  the  above  formula  and  adding  to  the  ROP  to  obtain  the 
updated  RO.  A similar  comment  applies  to  the  updating  of  the  ROP  itself.  At 
the  time  of  an  updating  of  the  demand  or  OST  forecast  it  is  very  simple  to 
recalculate  the  corresponding  updated  ROr  and  RO.  Thus  it  is  possible  to  simply 
maintain  updated  values  of  both  of  these  fundamental  inventory  control  levels  and 
obtain  the  most  effective  performance  possible  from  the  demand  and  OST  forecasts. 
This  updating  procedure  would  occur  monthly  for  demand  forecasts  since  these  are 
updated  monthly.  For  item- forecast  items  the  updating  would  occur  on  the 
occasion  of  each  new  OST  observation  (requisition  completion) , at  which  time  the 
OST  forecast  is  updated.  For  OST  group-forecast  items  the  rate  of  group  OST 
observations  is  much  higher  than  for  individual  items.  OST  group  forecasts 
would  not  generally  be  updated  for  each  OST  observation.  As  discussed  in 
section  IV.  B above, there  is  no  significant  deterioration  at  intervals  of  up 
to  30  days.  The  OST-group  update  intervals  will  depend  upon  the  group  re- 
quisition rates  and  available  file  storage  space.  These  factors  would  have  to 
be  taken  into  account  in  any  implementation  of  the  recommended  OST-forecast  model, 
OSTES. 
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APPENDIX  A 


US  DARCOM  LCA/LIF  DATA  ELEMENTS 


For  each  LIF  record  (requisition)  the  following  selected  data 
elements  are  defined: 


Basic  (leader)  record  field 


CODE 

DIC 

RIC 

NSN 

UI 

QTY 

DODAAC 

RONDT 

D 

PRI 

UP 

ALOC 


DESCRIPTION 

Document  Identifier  Code 
Routing  Identifier  Code 

National  Stock  Number 

Unit  of  Issue 

Requisition  Quantity 

Identification  of  Requisitioner 

Requisition  Date 

Demand  Code 

Issue  Priority 

Unit  Price 

ALOC  Indicator 


Segment  record  field 


MIRP  Master  Inventory  Record  Post  Date 

DEPOT  Shipping  Depot 

BOI  Backorder  Indicator 

MODE  Mode  of  Shipment 

SEGQTY  Segment  Shipped  Quantity 


r 
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APPENDIX  B 


DEFINITIONS  OF  ROUTING  INDICATOR  CODES  (RIC) 


RIC 

AKZ 

AP5 

A12 

A35 

B14 

B16 

B17 

FFZ 

FHZ 

FLZ 

MPB 

N35 

S9C 

S9E 

S9G 

S9I 

S9T 

GNO 


COGNIZANT  AGENCY 

U.S.  Army  Tank  Automotive  Readiness 
Command  (TARCOM) 

U.S.  Army  Support  Center 

U.S.  Army  Transport  Support  Command  (TROSCOM) 
(TROSCOM) 

U.S.  Army  General  Military 
and  Parts  Center  (GMPC) 

U.S.  Army  Armaments  Command  (ARRCOM) 

U.S.  Army  Electronics  Command  (ECOM) 

U.S.  Army  Aviation  System  Command  (AVSCOM) 
Sacramento  Air  Materiel  Area 
Oklahoma  City  Air  Materiel  Area 
Warner  Robbins  Air  Materiel  Area 
Marine  Corps  Supply  Activity 
Navy  Ship  Parts  Control  Center 
Defense  Construction  Supply  Center 
Defense  Electronics  Supply  Center 
Defense  General  Supply  Center 
Defense  Industrial  Supply  Center 
Defense  Personnel  Support  Center 
GSA  Federal  Supply  Service 
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APPENDIX  C 


MODIFICATIONS  OF  THE  ANALYTIC  OST-FORECASTING  INVENTORY  CONTROL  EVALUATOR 


f 


In  the  memorandum  "Analytic  OST-Forecasting  Inventory  Control  Evaluator", 

R.H.  Davis,  13  September  1977,  were  derived  Che  formulas  for  calculating  the 
inventory  and  service-level  effects  of  OST  forecast  errors  for  individual  items 
The  formulas  used  for  the  average  number  of  backorders,  BO,  and  the  not-in-stock 
rate,  NIS,  were  the  usual  formulas  that  apply  when  shortages  and  backorders  are 
not  too  large.  However,  it  was  found,  especially  for  the  CONUS  DSU  that  has 
a quite  low  safety  stock  average  period  (5  days) , that  this  assumption  was  not 
satisfied  and  therefore  the  formulas  were  modified  to  give  more  accurate  results. 
The  original  expression  for  20  was 

BO  = D • BO  / Q 
o o 

where 

B0q  = (a2/ 2D)  • G(t) 

2 

G (t)  =0. 5e  " <at  + bt) 

a = .362805 

b = 1.513 

t = ( R0P-  p)/o 

In  the  exact  formula  for  BO^  , G (t)  is  replaced  by 


G (t)  - G ( t + q ) 

where 

q - Q/  o 

Consequently,  this  change  was  introduced  into  the  evaluator. 

Similarly* in  the  exact  expression  for  the  NIS,  E (t)  is  replaced 
by  E (t)  - E ( t + q) . 


The  expression  used  by  approximating  E(t)  was  for  the  form 


E ( t ) = Be 


a'  t2  + b'  t ) 
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This  formula  and  the  one  given  above  for  G(t)  are  good  individual 
approximations  to  their  respective  functions,  however,  there  is  a theoretical 
relationship  that  exists  between  G(t)  and  E(t) : 

E(t)  = - 0.5  (dG/dt) 

It  is  important  when  evaluating  small  differences  in  performance  of 
alternative  OST-forecast  models,  as  was  the  case  in  the  present  study,  that 
this  relation  be  satisfied.  Otherwise  anomalous  results  can  occur  - for 
example,  non-optimal  safety  stocks  can  yield  lower  total  cost  than  optimal 
safety  stocks.  Consequently,  the  formula  used  for  E(t)  was  that  given 
by  the  above  relationship: 

E(t)  = (2at  + b)G(t) /2  . 

A listing  of  a FORTRAN  computer  program  for  the  modified  analytic  inventory 
control  evaluator  (ICEVAL)  is  given  on  the  next  page. 
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APPENDIX  D 


SYNTHETIC  5-YEAR  OST  TIME  SERIES  FOR  THREE  TEST  ITEMS 


DSU:  704th  Maintenance  Bn. 
RIC-Group  I 


Item 

No  : 1 

2 

3 

NSN : 

7146156 

6784131 

1345093 

X = 40.1  days 

31.9  days 

63.8  days 

x " 12'2  " 

7.7  " 

18.3  " 

Origination 

Time 

OST 

Origination 

Time 

OST 

Origination 

Time 

OST 

y 2417* 

36  days 

2419 

36 

2408 

80 

2434 

44 

2425 

25 

2412 

43 

2444 

27 

2429 

23 

2412 

69 

2444 

51 

2445 

33 

2413 

59 

2457 

38 

2450 

22 

2426 

52 

2464 

30 

2458 

25 

2426 

91 

2465 

35 

2460 

46 

2443 

79 

2476 

57 

2462 

31 

2444 

70 

2491 

45 

2464 

35 

2464 

44 

2495 

49 

2472 

19 

2472 

51 

2513 

31 

2479 

24 

2473 

60 

2516 

63 

2495 

40 

2476 

77 

2521 

57 

2504 

29 

2495 

36 

2528 

32 

2507 

26 

2495 

78 

2534 

64 

2510 

39 

2512 

44 

2536 

51 

2515 

18 

2527 

50 

2541 

35 

2533 

33 

2535 

• 41 

2545 

25 

2539 

22 

2538 

107 

2562 

41 

2540 

27 

2540 

73 

2565 

60 

2542 

35 

2563 

63 

2584 

36 

2547 

24 

2564 

51 

2588 

35 

2548 

31 

2569 

63 

D-l 
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2597 

22 

2550 

42 

2587 

57 

2620 

31 

2553 

22 

2594 

96 

2621 

18 

2566 

22 

2600 

107 

2621 

51 

2569 

32 

2604 

129 

2625 

47 

2571 

30 

2609 

56 

2632 

44 

2606 

21 

2610 

50 

2643 

40 

2615 

47 

2617 

45 

2663 

29 

2616 

24 

2640 

40 

2687 

53 

2621 

28 

2644 

77 

2687 

76 

2626 

23 

2673 

44 

2688 

27 

2645 

21 

2677 

60 

2699 

23 

2650 

30 

2685 

67 

2709 

28 

2656 

36 

2696 

44 

2715 

30 

2660 

22 

2696 

68 

2724 

36 

2670 

39 

2701 

54 

2735 

28 

2700 

35 

2704 

52 

2742 

41 

2700 

40 

• 2708 

72 

2754 

52 

2704 

45 

2708 

99 

2765 

43 

2705 

34 

2709 

90 

2774 

42 

2708 

32 

2711 

69 

2787 

38 

2712 

29 

2714 

42 

2794 

68 

2712 

37 

2719 

60 

2806 

83 

2716 

32 

2731 

63 

2716 

39 

2736 

60 

2730 

28 

2765 

40 

2730 

30 

2769 

46 

2732 

37 

2779 

57 

2741 

28 

2780 

96 

2790 

60 

N = 45  days 

50 

51 

X = 42  days 

30  days 

64  days 

ax=  15  days 

7 days 

20  days 

* Days  are  from  a 1 Jan.  1970  origin:  Note  that  time  scale  has  been  compressed  by  a 
factor  of  about  5.  This  is  for  the  purpose  of  using  the  item  OST  series  as  the 
forecasted  series  together  with  the  (sampled)  RIC-Group  I OST  time  series  for  generating 
the  forecasts.  Thus  the  item  and  group  OST  series  cover  the  same  time  period. 
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APPENDIX  E 

202-OST  SAMPLE  TIME  SERIES 

DSU:  704th  Maintenance  Bn. (CONUS) 
RIC-Group  I 


Requisition  Dates  * 

2373. 0 02  415. OC2416.C32416.CC2416.0C2420. 002-423. 10242  6. CC2429. 0 0 242  7.1? 
2 42  9. 002420. 002430. 00243C.CC2430.C02433.C  02  433. <302434. CO  24  35. 002425.  CO 

2436. 0 02437. 002441. 002442. 0024 44. 0C2444. 0 02447. 0 0244  7.002 44 3. 00 2443.': 
2449. C02451. 002431. C02451  .C02451.CC2454. 00245a. 002  4 5Q. 0 0 2453. 002  4 o -3.0  0 

2 461. 0 024 6 1.0 02462. ,0  02468.002468. 0 02466.0 02470. 00247C. 0 0 2471. 0 02472. 00 
2472.0C2  472.0  024  76.0024  7o.0  02  4 76.0024-3  0.0  02480.00  2483.C0248  3.0  0 24  64.0C 
248 4. 002486.' 02466. 002 4 66. 002491. OC2402.0C2496.C02501 .002506. 002503. : C 
2212.  002514. 0 02515. 002515. 002523. 0C2526.CC2527.0C2528. 002 52  9 . 002522. CO 
2236. 002536. 002542., C02546. CC2546. C 02553. C 0 25  oC.C02  5ol. CO  2565.  OC  25  o 5.  CO 
2566. OC2566.0C25  66. 00  25  66. CC  25  69. 002573. 00  2-5  73. 0C2573.C0  2575.0  0 237o.C0 
258  3 . CC259C .0  0258  1 . 0C2593. CC253Q. CC2592. 002592. C02593 .0  225  9 ».  30  25  95  . CO 
2 59  6 . 002596.0 02597. 002600.0026Cl.0C26C7.C026C7.002oC3.0C2 6 C8.002o0d.  OC 

261 2. 00  261  3. 0 02  61 3,0  0261 3 .C0261 3.0C2  6 1 6.C0262C .CC262C  ,002o2 1 .0C2u2i  .0  0 
2624. 0''2628.00263C.002630.C02632. 002635. 002637. 00  2 638. 002641. 002  64  1 .00 
0 64 1 .002642. OC 2644 .002644 . C 026 44 . 0 C 2644 . 0 0 2 64^. 0 0 2 643 . 0 0 2 64 8 . 0 C 2o 4 9 . 0 0 
2650. 002652. 002655. 002657. 002  6 5 9. CC2661. 0026  64. 0026  64. C0266  9 . 002669. CO 
2 67 C. 0 02671. 0026 72.0  02676. C 02 6 76. 0C2677. 0026 77. 0026 78. 002678. 002680. 0 0 
2 694. 002 6 85. 0 02686. C 026H8. C C2 69C. 002692. 002697. 0026 9 3. 002 70 2.  OC 2 71 1.0  0 
2 "’ll. 002711. 002713. 002714. CO  2715. CO  2715. 002718. 0C2721.CC2722. 00272-3. OC 
2729.C02732.  302734. C02735.002‘T35.0C2735. 0 0 2735. 00  2 735. 002735. 0Cc.'’j6. 00 
2 "'4  1 .002  743.0  0 


OSTs  (Days) 


43.00 

27.00 

26.10 

26.00 

45.CC 

22.00 

19.00 

22  .OC 

3 2.00 

35.03 

3 i.  OC 

24.00 

32.'0 

53  .CC 

83.CC 

2 1.33 

50  .CC 

5 7.CC 

35.30 

■ 3 . C 

27.  OC 

24.00 

50.00 

4 9.00 

19.00 

3 2.03 

2 3.  OC 

44.00 

2 8.30 

13.-3 

3 5 . 0 C 

2 9.00 

32.  -C 

4 0.00 

79.CC 

4 4.-30 

2„  . CC 

2 2 . 0 3 

2-.0  0 

7i , “ e 

40.00 

67.00 

8 5.00 

30.CC 

43.00 

93.00 

43.00 

91.CC 

55.  OC 

34.00 

54.00 

57.0  3 

30.00 

oC  • 0 0 

70.00 

26.00 

62.00  • 

25  .CO 

32 . 30 

2 2.C3 

56.00 

29 .00 

50.00 

61.00 

23.00 

26.  OC 

20.00 

27.00 

3 0.30 

3 1 .CO 

33.0  0 

3 1 .00 

2 7 . 0 C 

*4.00 

42  .OC 

32.00 

42. OC 

44.00 

5 1.CC 

4 1 .00 

2 9.00 

57.00 

3C.C0 

42.00 

55.00 

42.00 

28.  OC 

40 .00 

3 3.00 

53  .CO 

2 9.00 

2 9.00 

50.00 

75 .00 

67. OC 

22.00 

28.0  0 

59.30 

45.33 

6o.C3 

33.00 

43.00 

26.00 

49.CC 

49.  OC 

3 1.00 

63.CC 

39  .c  e 

44  . OC 

4 3.ee 

27.00 

42.00 

35.C0 

4 1.CC 

4C.CC 

23.00 

34  . CC 

29.  CO 

3 3.30 

5 9.0  3 

25.00 

28.00 

28.00 

2 3.00 

32  .OC 

29.00 

2-*.  00 

49  .OC 

24.00 

2 9.00 

25  .OC 

21.00 

20  . CO 

73.CC 

68.CC 

29.00 

3 2.30 

64.3  3 

22.  30 

4 3.0  C 

6 1.CC 

34.00 

25.00 

32.CC 

32  .CO 

47.30 

3 1 .OC 

23  .CO 

29.00 

5 ' - ' 

— w • s. 

47. OC 

24.30 

21.00 

21  .CO 

29. OC 

2 6 . C 0 

2c.ec 

8 4.00 

1 9 . OC 

■5^*0  v*. 

5 6 . 0 C 

31  .OC 

39.  CO 

26.00 

35.00 

25.00 

49. CO 

29.00 

86.00 

27.ee 

2 7 • 0 C 

40.30 

35.00 

63.CC 

5 1.00 

3 1.00 

35.00 

6 4,00 

54.30 

20  . 1 C 

32  .OC 

59.0  0 

30  .CO 

27.00 

36.00 

36.0'' 

25.  CO 

27.00 

2 1.30 

’7. CO 

2 3 . 0 C 

24.00 

2 9.33 

21.0  0 

29.ee 

29.00 

33.CC 

34.CC 

3 o • 0 0 

_ 3 . C - 

3 0.00  23.00 


* Number  of  days  from  1 January  1970  E-l 
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APPENDIX  F 

205-OST  SAMPLE  TIME  SERIES 

DSU:  703rd  Maintenance  Bn.  (EUROPE) 

ALOC  Requisitions 
RIC-Group  I 


Requisition  Origination  Times  * 


.7=560 
<2=59  0. 
2 39  7 
2 617 
262  5 
2620 
’*>35 
2638 
2o4  3 
2649 
2t54 
2656 
2 6 60 
2665 
2668 
2675 
2 679 
2 684 
2 6<>  1 
2 694 
2 T34 


•002563. 
. 0C2 591 . 
.002593. 
• 0026 19. 
.002626  . 
.002630. 
.002635. 
.002638. 
.002644. 
.002649. 
.002654. 
.002638. 
.002660. 
.002665. 
.002603. 
..002675. 
.002679. 
■ • 002685. 
.002691 . 
.002694. 
••002737, 


: 0 2 5 f 9 
002593 
CC2f>  00 
0 C 2 o 1 9 
C C 2 t 2 6 
C 02630 
0 0 26  35 
002640 
002644 
002650 
002656 
C C2655 
002660 
0 02665 
CO 26 71 
0 02677 
0 02679 

002685 
002691 
002695 
C 0 2 7 37 


.002573 
.0025  95. 
.002602 
,0  0261  3 
,002626 
,002631 
,002635, 
,002640 

,002644 
,002650 
, 0C265o 
,002659 
,002664 

>002665 
. 0C.-6  71 
.002677 
.002680 
.002686 
. '02 6 9 1 
.002695 

. "2737 


,0  025  76. 
,002595 . 
,002604. 
,00261 3. 
.00282  9. 
.002631 . 
,002625. 
,002640. 
,00  2 644 , 
.002651 . 
,002656. 
.002659. 
.0^2664 , 
.002666. 
.002671  , 
.002677  , 
.002680 , 
.002687, 
.002692, 
.0026  98, 
. 0^2  737 


^ C 2 5 7 9 
002596 
CC 2c05 
0026  1 8 
0 C 2 6 2 9 
0026 32 

002637 
C C264C 
0 C 2 6 4 4 
C 0265  1 
C C2658 
002659 
C C 2 6 6 4 
CC2566 
0C2o71 
C C 2 6 7 7 
00268 1 
0C2o87 
,002692 
C 02  699 

or  7 


. 002560  . 
.002596. 
•C02610. 
.002622. 
• 0 0262  ) . 
.002632. 
.002628. 
.002642. 
. 00  2645 . 
.002653. 
.002656. 
. 002659. 
.002664. 
.002666. 
.002671. 
.002677. 
.002661. 
'.002687. 
1.002693. 
,.  002721  . 


O'"  2 58  3 
CC  2596 
C C 2 6 1 l 
002622 
"=  C 2 6 2 9 
00  2632 
0 C 2 6 3 8 
00  2642 
0 0 2 645 
002653 
0 0 2 o 5 8 
OC  2659 
002664 
002667 
002672 

002677 
00268? 
002607 
00  269  2 
0 0 2 72  2 


. 00  2590 . 
.002597. 
• 00261  . 
. 00  262  3. 
. C : 2 6 2 0 . 
.002632  . 
.002638. 

.002642. 

.002646. 

.002653. 

.002653. 
.002660 . 
.002664. 
.CO 266 7. 
.002672. 
.032678. 
.002682. 
.0 12688. 
. o 3 2 v>9  3. 
. .C272  9. 


: 02  6 30  . C 3 
00  259T . C 0 
00261  _ 0 
OC  2624 . 0 o 

002630.00 
3 0 26  3 3 • 0 0 
00  2638  . OC 
00264  1.00 
0 0 2 646 . 0 0 

002653 .0  0 

002656.0  : 
00?  660  . : 0 
0 0 2 6 6 -o  . 0 1 

002667 .00 
0 0 2 6 7 3 . r 3 
002678. C 0 
■00  26  34  . C 0 

002639.00 
5 o 6 34  . o i 
0 0 2 7 19.00 


Requisition  OSTs  (Days) 


2  4.00 
•45.00 

34.00 
6 J . 00 
28.  OC 
5 0.00 

23.00 

49.0  0 

71.00 

17.00 
2 8.00 
30. ~C 

21.00 
2 3.00 
2 4.00 

18.00 

46.00 

35.00 
2 3.00 
2 7 . * 0 
27. CC 


60.00 

96.0  0 

25.0  0 

38.00 

34.00 
5 0.00 

24.00 

57.00 

27.00 

21.00 

49.00 
3 5.00 

26.00 
23.  Or 

44  . CO-- 

3  9.00 

28.00 
2 3.00 

23.00 

43.00 

18.00 


3 7.00 

22.00 

56.00 

46.00 
3 9.00 
29.  CA 
35. OC 

26.00 

37.00 

23.00 

25.00 

2 1.00 

24 .00 

3 3.00 

23.00 
2 2.00 
2 7 . 6 c 

26.00 
36  • C 0 

4 0.00 

18.00 


35.  or 

1 1 3 .00 

54.00 

47.OC 

3 1 .CC 

62.00 
74. CO 

26.00 

43.00 
19.  OC 
3C.CC 
22. OC 
24. OC 
2 0 . C 0 

28.00 
^D."C 
39.0C 

25.00 
25. CC 

45.00 

21  .CC 


35.00 

8 7.00 

27. CO 

75. 00 

92.7  0 

19.10 

2 7,00 

I 1 O • « 

13.00 

1 ^.00 

6 0.  OC 

73.00 

54.00 

1 8 . 0 C 

9 4.  . 0 7 

53.10 

23.0  0 

60.00 

4 2. 00 

J *4  . '0 

36.00 

49.0C 

74.00 

3 0.30 

4 9.00 

26.00 

26.01 

3 3.00 

110.00 

21  . 30 

4 5.00 

2 7.00 

2 3.00 

3 0.00 

37  .C  3 

4 C . 0 0 

2 3 . 3 0 

38.00 

107.00 

3 2.7  1 

69.00 

34. CC 

42.00 

25.00 

32.00 

2C.C0 

24  . CC 

2 5.00 

29.00 

39.03 

22.00 

2 3 . 0 C 

2 3.00 

23.00 

2 7.00 

22.00 

26  . OC 

44.11 

2^.30 

2 .30 

2 9.00 

29.00 

36.00 

7 9.00 

22.00 

2 6.00 

2 7.  cc 

19.00 

2-3.30 

=*E . - : 

4 i . 0 c 

43.00 

2 0.00 

2 2.00 

1 V.  7 0 

3 2 . 0 0 

42.00 

4 7.00 

17.30 

2 5.00 

22. 00 

4 3.00 

30.0  0 

60.00 

23.0  3 

25.0  1 

39.00 

r,  2 . 0 C 

3 • . 0 C 

2 - . : " 

5 C . C 0 

26.  CC 

28.00 

50.30 

25  .v!  3 

2 5.00 

42.00 

14.00 

2 0.37 

32 .0  1 

* Days  from  1 January  1970 
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SIMPLIFIED  MODIFICATION  OF  THE  OSTES  MODEL 


In  the  memorandum  "OST  Forecasting  and  Evaluation  Models",  18  August, 
1977,  pp.  17-20,  the  original  OSTES  forecasting  model  was  described.  It 
involved  two  response  time-period  parameters: 

T^  = the  effective  OST  sampling  interval 

T^  = the  effective  demand-rate  sampling  interval 

These  two  parameters  exert  the  primary  control  over  the  automatic  adaptive 
calculation  of  the  smoothing  constant,  a , in  the  procedure.  Two  additional 
parameters  that  exert  secondary,  and  overriding,  control  over  the  a cal- 
culation are  e . and  e the  minimum  and  maximum  desired  % error  in  the 
forecast  of  thein0ST  mean?  One  of  the  simplified  modes  in  which  the  OSTES 
model  can  be  used  is  to  nullify  the  effect  of  the  two  response  parameters 

T and  T and  to  utilize  the  single  parameter 
A A 

e . = e = e 

min  max 

■I 

to  control  the  adaptive  calculation  of  the  smoothing  constant,  a . 


The  adapative  formula  for  a is: 

, A2,  2 

ct  = 2.  (e  . X)  /a 

where 

A 

X = the  current  OST  forecast 
2 - 

= the  current  variance  of  OST  forecast  error 
The  updated  OST  forecast  is  then  given  by: 


where 


X 

X 


a • X + ( 1 - a ) .X 
the  current  OST  observation 


This  procedure  is  very  simple,  but  it  depends  on  mantaining  a current  value 
of  the  forecast  error  parameter  • This  quantity  is  related  but  not 
identical  with  the  RMSE  measure  of  forecast  error.  This  relationship  is 
given  by 
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(Continued) 


RMSE2  = a 2 + E 
E 

where  = 

E 

= the  current  value  of  the  bias  of  the 

OST  forecast  (average  error  of  forecast  ) 


So  an  updated  value  of  a^,  can  be  calculated  from 


2 - 2 
RMSE  - E 


2 

where  RMSE  and  E are  updated  values  of  these  error  measures.  During 
the  OST-forecast  simulations  in  the  present  study  the  error  measures 
(RMSE,  E , a ) were  calculated  directly  from  the  time  series  of  forecast 
errors  generated  by  the  simulation.  In  practice  the  values  could  be 
simply  updated  by  exponential  smoothing.  Using  a smoothing  constant 
corresponding  to  about  20  past  OST  observations,-  these  updating  formulas  would 
be 

E=0.1(X-X)+0.9E 
RMSE2=  0.1  ( X - X )2+  0.9  RMSE2 


where  quantitites  on  the  right-hand  side  are  current  values  and  those  on 

2 

the  left  are  updated  values.  Then  the  updated  value  of  a is 


V 


2 -2 
RMSE  - E 


The  simplified  procedure  is  then 


1.  Specify  the  forecast  error  parameter,  e . 

2.  Specify  current  values  of 


X 

= 

the 

OST  forecast 

X 

3 

the 

OST  observed  value 

I 

- 

the 

OST  forecast  bias 

2 

- 

the 

variance  of  OST  forecast  error 

APPENDIX  G 


(Continued) 


3.  Calculate 

9 > 9 

a = (2e  ; X V a/ 

2 E 

2 2-  - z 
RMSE  = aE  -f;  E 

E = 0.1  ( X - X ) + 0.9  E 

a 2 =0.1  ( X - X )2  - 0.9  RMSE2  - E 2 

h 

, X = aX  + ( 1 - a )X 

4.  Save  'x'  , E , a ~ for  next  forecast. 

E 
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LISTING  OF  OST-FOPJ^CAST  ERROR  SIMULATOR/ EVALUATOR  COMPUTER  PROGRAM  (FORTRAN) 


STATS  TRACE  COC  6700  K TM  V3.3-3S5F  OPT 

PROGRAM  STATS  ( INPUT  . TAPE  1 , TAPES  .OUTPUT  . T APCo = UU T PU T I 
U l vs  NS  I JN  l A ( d ) 

UtAd  ( 2 , i ) 1 A 

I FORMAT  ( H A I T ) 

ntAOl  1 . I 1 1 I ) I NOX  X 
1111  FORMAT  (II) 

WHIT?  <o,:23>  INOXX 

123  FORMAT  (*  NUV.j.IR  or  tiA'A  SETS  *.12  1 
00  090  I NOX* 1 . I NOX  X 
PRINT  A . 1 A 

O FORMAT  ( 1 H 1 . 3 A 1 ? > 

PRINT  ’ 

7 FORMAT  (*  PROGRAM  CSTN  *) 

CAU.  OST.N 
PRINT  P 

■3  FURMAT  ( 1 H 1 , * PROGRAM  OSTM*,/) 

CALL  OSTM 

pc  I NT  -> 

9 FORMAT  ( 1H1 .*  PROGRAM  USTT*./) 

CALL  Obi T 
PRINT  i: 

1C  FORMAT  ( 1 Ml  t "PROGRAM  OSTNE  *.//) 

CALL  OSTNE 
PRINT  11 

II  FORMAT  ( 1 H 1 . * PROGRAM  OSTES*./) 

CALL  OSTES 

PRINT  12 

12  FORMAT  UHl.*  PROGRAM  0ST0E5*./) 

CALL  U3TDLS 

Point  13 

13  FUR  1 A T (IMI.a  PROGRAM  CSTNP*./) 

CALL  05T.NP 

print  :a 

1a  rU'-MAT  ( 1 H 1 . * PROGRAM  OSTES!5*./) 

CALL  OSTt'SP 
PR  I N T 21 

2!  FORMAT  (IN).#  PROGRAM  03TR.  LEAST  SQUARES  T > CN OL I N? • * . / ) 
CALL  OSTR 
PRINT  22 

.’2  FORMAT  (1H1  .«  PROGRAM  O'STMO.  MUUt;  SEARCH.*./) 

CALL  U3TM0 
iN  1 CONTI NU£ 

STOP 

LNO 
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SUUROUTfNE  CSTm 

COMMON  A}/  Nl . Tt 20CC > .X (2020) . TGI  2000 ) .X3 <20  DC > 

I'cAL  -I 

Kr.AIM  J . 1 C )N  . I * . 1 ! .NN,  N1 
10  FORMAT (5I3»  7F7 • 2 ) 

PRINT  1 : , N . I 0 . I 2 . NN • N 1 
SHAD  l 2 . 2C  > < T < I > . I =1  ,N  ) 

RE AD<  2 . 2C  ) ( X ( I ) . I =i .N ) 

READ ( 2 > 2C  ) ( TS(  I ) .1  = 1 . N1  ) 

RE.  AO  ( 2 . 2C  > ( XS  ( I ) . 1 = 1 , N1  ) 

20  FORMAT ( 1 CF7 .2) 

M = C . 

SH  = 0 . 

SG2=0. 

SAc=  0 . 

tic=t<  r: ) 

SKMSE3=0 . 

3H«3E=:  . 

SSRMS£=0 . 

SSSRMSE=C. 

K=0 

5 K =<♦! 

T SK  = T 3 ( K ) 

II ( T3K.LT . T IC )GO  TO  5 
D J 70  I = I C . I 1 
K = K-l 
S = C . 

NNN=  0 

00  25  J = 1 . I 

: j-r-j* i 

NNNsNNN* i 
5 = 5F.K  ( I J ) 

ir(NNN.EQ.NNlGO  TO  27 
2r'  CONTINJ- 
27  XX=S/NNN 

IP1=I ♦ 1 
T1PI*T<  IP1  ) 

2<l  K*K+  1 

IFIK.GT.N1 )G0  TO  70 
T 5K  = T 5 ( K ) 

IF < TSK.GE. T I PI >GO  TG  30 
M = M F 1 . 

F=XX-X5(K ) 

SE=SS+_ 

SE2=SC2+h*fc 
S Al=SA;. AMS ( E I 
EI3=SC/M 
AEJ=SA£XM 

I K < M.GT  . 1 . I GO  TO  50 
S I G E = C . 

GC  To  02 

5C  A- ( St2- ( S£ *SE/M > ) /( M- 1 . ) 

OIor.  = SOR  T ! A ) 

2 S IGGl>  = S i CF/SCRT(FLGAT(  FINN*  11  ) 

pm5E  = 5JPT ( G I GL  *S I GE  + Et  *50 ) 

SS5PMSF  =5t|RT  I • - rt  ( R **  5 L - R MGE  ) * * 2/v  t • o * S 5 5 1 MS  c.  * 55  SR  MS  £ ) 

SSRMGFs.2  MSr. ♦ . 7 *03GMSE 
RM5r.U  = S JFT  ( 5 U.£U«S  lCEB»Eb»StJ  ) 

O t:  L T » RM  5 E n - 3 ■'  1 ■-  r I 

SRMSE  = SOF  T l . 2w'JtLT*0ELT/9  ♦ . -j*SR  ASE*SRM5k  ) 

S"  MGE  11=  • 2*0  A JR  ME.;:  o 

PRINT  23  . XX  , = 0.  SI  CE  .5  IgEU.  AErt.RMSd,  SSi-'MGt  . S jSRMSE  .rlMGFa  . SS«5;d 
PR INT  2 C • SR  4SL 
GO  TO  2 7 
2'  CONTINUE 
70  CONTINUE 
«L  Torn 
F.NO 
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THIS  PAGE  IS  BEST  QUALITY  PRACTICABLE 

from  copy  FURAISHED  to  ldc 


SUURGUT I NE  USTm 

COMMON  /LV  N1  . T(  'C  VC  I . X(2:0*  ) . TS(  tCOJ  > . X 3(2  COC) 

rial  m 

R?  AO  ( 1 , 1 C 1 N , I C , I 1 , NN,  N1 
;c  F OHM  AT  (•}  13  . 7 F 7 • 3 ) 

PPPir  l C >N<  1 C . !1  .NN.N1 
RE  AO  ( 1 . z:  ) { T ( I ) , I = 1 .N  ) 

P LA')  ( l .«•:<■)(  X ( I ) . I =1  ,N ) 

Kf ADI  1 . 2C  ><  TS< I ) . I =1 , N ) 

wlao ( i ,rc ) ( xs(  i ) . i = 1 . n) 

20  FORMAT! 1CF7.2) 

M = C . 

SE  — C . 

SE2  = C . 

SA c=o . 
t i c = t ( i : ) 

SPMSuL'  = C . 

SR  M SE  =0  . 

K=0 

5 K=K+1 

IF! TS( K ) ,LT. T 10 IGG  TO  5 
00  3 3 [ = IC , I 1 

K = K-  1 

DO  32  J= 1 . NN 
I J=I-JF1 
Y = X( I J ) 

MM  = C 

HUM;' 

DO  34  JJ=1 .NN 
L=  I-JJK 
XL;X ( L ) 

IF  ( XI.  .L  T . Y ) VM=MM*  2 
IF ( XL .L£ . Y ) XMHaMMM *2 
1F( MM ,GT ,NN)GC  TO  32 
J A CONTINUE 

IF ( ( MM.LE .NN ( • AND . ( WMM .GT .NN ) ) GO  TO  36 
32  CONTINUE 
56  X X = Y 

PR  IN7  2C.XX 
I P 1 = I ♦ 1 
T I P 1 n T l I P 1 ) 

24  K = K + 1 

IFlK.GT.Nl  >G0  TO  7 C 
IF ( TS(K ) .GL . T IP1  )GU  TO  33 
MsM  + l . 

E=XX-XS(K  ) 

SE=  SE  + i 
S-2  = S£c:Fr*E 
SAF=r3A:2  + AHS(  =1 
£l  = SE/'-i 
AEBaSAE/M 

IF ( M.GI . I . )GC  TO  SC 
S I Gr.  = C . 

C.C  TO  0 7 

3 A= CSE2-I SE*SE/M>)/I M- 1 . > 

S I GL  = 60.0  T ( A ) 

s : lutd  5 1 <>.  /scR t ( r lcat  ( nnf  i > > 

R A S t . = S CM  T ( 5 I GE  * S I G r.  + . 1 1 * L 0 ) 

R ’M  b _ b - S O n f ( S I G E i j • S I Gc  o f S d * r i ) 

OLLT=f.:.lo£.0-iKv-f-ij 

S ' b - SJK  T ( * 3 *0f  LT4i'ELT/#F*  < * s -M  b ; *5  ) 

S R M S •£  0 - . / * R ;/.  SH  u ♦ . !«3»<  % r j 

I’l.  : H I • . ■ X X • C J • 3 I C i.  • 3 I GL  *5  . A Lb  • R MS  c • WSu  l , SMM  Su  J , 
t»U  T ; £ 4 

c ■ JT  I NO 2 
'0  CONTINUE 
I'i.  * l/R N 
fc  Ni) 
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THIS  PA&E  IS  BEST  QUALITY  PRACTICABLE 

from  copy  furnished  to  dlc  


l i j i ki  j /-  i 

Cc.'MMC  I /."/  N 1 , Tl  ±r.CO)  ,X  ( 2230)  . T3(  2000  ) , XS12000) 

R .,L  ' 

« L A O [ • , I C )N,  I : , | 1 , Ml  , N ’ 

1 - FUR  1 AT  ( 5 I .■  , ’F’  .w  ) 

PRINT  I C .N  . 1 0 . I 1 ,\N.M 
READ!  t . 2 C M Tl  I I . I = 1 , N > 

Rfc  AD<  1 , 2C  M .<  ( I ) . 1 = 1 ,N  ) 

READ  (I  , J’  l(  TSI  II  ,1  = 1 . N) 

RC  AO  ( I ,_C  ) ( XS<  I ) , 1 = 1 ,N) 

2 C FORMAT ( 1 :K7 , 2 I 

M = ~ . 

sc=c  . 

SE2  = C . 
sae  = : . 

SPM5E’J  = C . 

S3P.1SE  = C • 

sssrwse^ . 

SnMST=" . 

T I 0 = T ( 1C  ) 

K = 0 

5 K=KM 

TSK=TS(K I 

IF ( TSK.LT.T1  0 )GO  TC  5 
DU  3 C 1 = IC  . 1 1 
K = <-  l 

DU  IS  L=1 ,NN 
L2=LF I -NN 
»(LI=X(L2I 
1 5 LO NT  INUC 

CALL  SU~ TAG ( Y . 1 ,NN , l ) 

LO  = 1 
L 1 = NN 

FN=FLOAT ( NN ) 
b=Y  < L C I 
C = Y (L  1 I 

35  1F( l C-d) .LT. 1 . )oU  TC  6 5 

A=  ( d + C 1/2  . 

oo  ac  l=l:.l: 

IF  ( Y ( L ) .01  . A I GO  TO  A 5 
AC  CONTINU_ 

45  FL=FLCAT(L-LO  ) 

IFlYlLJ.LT.A  >FL=FL + 1 . 

IFCKL.LE.FN/2 . I GO  TC  5 = 

C = A 

!F(Y(|.  ) . GT  . A >L1=L-1 

FN  = FL 
GO  TO  35 

55  IF (FL.tfl.FN/2 • ) GO  TO  65 
d = A 
LO=L 

KN=FN-FL 
GU  TO  7.5 
65  XX  = ( 6*0/2. 

IP! =1 f 1 
T I r- 1 = T ( I P 1 I 
24  K=K+1 

IF! K .GT.N1 )uU  TC  7C 
TSK=T3( K I 

IF ( TSK .GO . Tl P 1 ) GO  TO  7C 
M = U ► 1 . 

£=XX-XS(K) 

5C=3C+w 
5t2=5E'  + 2 * 

5AE=3Al+Ao3  t E I 
E d = 3 F / M 
Atd=SAE/M 

IF ( M.GT . 1 . >0C  To  5C 
S IG2=C . 

GC  TC  iC 

50  a=  ( set  - ( :,r:  *5E/m  ) ) / { m-  i . ) 

SIGf:=&<!„T  ! A I 

,J  ~ 51GEd  = 5U'E/5CRT(FLCAT  (NN*1  ) ) 

i • -150  = 5.1  T l I Cl  '3  IC  5 D I 

SS5<V«55  = SOT-  I ( ...»  ( R vil ...*:wr»c  > »*2/9«-  . 8«SS3RMSE  *5SSRMS3  I 

5 i 1 ■ ‘A  5 c - • < ' *-  •'  5 t t . c * _ ..  v 3c- 

R F 3';  ( = r-c]i-  T ( 3 I -j‘.  r * S 1 ut.clF  Eu  * EU  ) 

UELl  = R Is'  l -GRV.aic 

Si;vSE  = 30A  T ( . 2 *l.f  L T *1)1  i r/v  + . s»5TMsE*5RMS:.  > 

G-'  «cri  -..  . ■ * : ..  .'SE cs 

PI!  1 IT  3 3 . XX, Ld. 5 I GL .3 IGEU . AEB.WM3E. SSHM54  . SssRMSt .RMS!  3. CAMS 
PR  1 NT  2 * , -.A  ■ I •;  L 
GU  T 1 2 A 
1 ‘ CONTINUE 
ln.  CUNT  INU. 

‘•L’U.N  H-4 
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THIS  PAGE  IS  BEST  QUALITY  FRACTICABLX 
FROM  COPY  FURNISHED  TO  DDG  .. - 


I 

I 


SUdROUT  IN'-.  .JSTT 

COMMON  />,/  N1»1!2CCC),X!2CC0)«TS!200C).XSI2C?C) 

RC  AL  M 

t-  c_  A O ( 1 . 1C  >N.  IC  . I 1 ..Nl  .TT  .E-4X.EMN 
1C  FORMAT  ! 4 I 3 , 3F'7.2  > 

PRINT  1 f . N . I C,  I 1 . N t . TT . EMX .EMN 
C REAL)  < 1 .2C  ) ( T ( I ) , 1 =1  ,N> 

L REAIM l .2C ) ( X ( 1 > , I = 1 ,N  > 

C Mr AO( 1 ,2C ) l TS<  I) . 1-1 .N) 

C r.FAD(l,2C)(XS<I).I=l,N) 

•>C  FORMAT!  1C  F 7.2) 

Ms?  . 

SC  =0  . 

Sc  2 -C . 

5 AE  = C . 

t i;*t{  i: » 

SRMOEBs'1  . 

SRMSE*C . 

K = 0 

5 K = lC*l 

IF ( T5IK ) .LT .T IC >G0  TO  5 

on  30  i-io.ii 

K = K-  1 
NNs? 

s=o. 

NU= 1 OCO 
T I = T C I > 

TP=TI -TT 

IF(M.LE.l . >G3  TO  32 

NL= INTI  I SICS/XX/EMX  >**2* .5>- l 

IF! NL  .LE  .C  I NL  * l 

NUs INTI  1 SIG2/XX/2MN)**2+.5)-l 

if ( no .l: .c i nu=i 

PRINT  1C.NL.NU 
32  DO  25  J=1 , I 
I J= I - J ♦ 1 
T 1 J=T( I J) 

IFIM.GT. 1. ISO  TO  21 
IF  1 T I J.GT. TP) CC  TO  23 

GO  TO  45  - 

21  IFINN.EO.NUIGO  TO  45 

IF! ( T 1 J.LT .TP ) . AND. INN.GE .NL I )GC  Til  45 

23  NN=NN*1 
S=SFX ( I J ) 

25  CONTINUc 
43  XXxS/NN 

PRINT  1C.NN 
PRINT  20. XX 
I P I 4 I ♦ 1 
T I P l = T | I P 1 I 

24  K = K.  + 1 

1FI* .GT.N1  >GO  TC  7 - 
II- I T51  K>  .G2.  T IP1  >GC  TO  3 0 
M =M*I . 

5=XX-X5! K I 
Si.=sE*t: 

SAF=SA£»Ad3<  E ) 

Ed=3E/M 

AEd=SAr/P 

IF  1 M ,ul .1.100  TO  5C 
S I GE  * 3 • 

GO  TC  60 

•30  A=(SE2-1  »c  * SS/M  ) I/1M-1  • ) 

SIgE=SGRT 1 A ) 

uO  SlGEd^jIGE/SORTlFLCATINN) ) 

RMSE  » S JR  T ! I Ci-*  » I Gc  ♦ r.  il*  Cd  ) 

RMSrpsSiVT!  3 I Gen  MS  I Gc  «♦  £tl  MLd  I 
CELT  sr,MS'.L'-iin«':G 

SnMSEvSOR I I . 2«0ELT*l?CLT/R » . 3* SRMS t *SRMSS  > 

4 1*  ■ ! 3 E L = .2*  4M  j - b ♦ • d * «>  '<  M E 2 d 
FNN=FLOAT 1 NN ) 

Pi-  I NT  2 J . X < . FNN  ,Eti  . SICE  . S IGcd  . ACU  .R.MSc  . RMSEd.  5WM32H,  sr,MSc 
GC  TO  24 
CENT  Ivor- 
•'  > CONTINUE 
m.  Turn 
CM) 


£U5. 


i 


*1 


is  ns,  »««.!« 


Q 

» I 


r 


C 


SUtlPOU T I NE.  ostns 

CCVMCN  /u/  N 1 . TI2C0C)  ,X(2?CC  ) , TSI  2C  0?  » .XSC20CC  » 

PEAL  M 

RtAtill . I C >N.  I * . I 1 .N1 ,EE 
1C  FORMAT! 41 3 * 7 F 7 • 2 ) 

PRINT  1C.N.  I C . I 1 • N 1 .EE 
C RE  AO!  1 , 2C  ) (T  ( I J .1*1  .M 

V.  RcAO<  1 , 2C  ) ( X ( I ) . I = 1 .N  ) 

<_  RF  AO(  1 .2C  ) ( TS(  1 ) . 1 = 1 .N> 

C READ! 1 . 2C )( XS< I » • I =1 .N) 

20  FORMAT C 1 CF7. 2 ) 

M = C • 

sc=c . 

S 32=0. 

SAE=C. 

T1 : = T(  IC  ) 

SR  M3£8  = : . 

SRMSEaC. 

5 K = K»l 

TSK  = TS(K  1 

I F ( TSX.LT  .Tit  100  TO  5 
00  30  I = I C . I 1 

IF ( M • G T .1  . 1 N\» | NT ( ( S IGE/XX/Efc ) **2+  »S  )- 1 
IFINn.le.c )nn=i 

PRINT  It. NN 
K = K-  l 
S = C . 

nnn*-: 

111=1-1 
00  25  J=1,I 
I J= I - J ♦ 1 
NNN=NNN* 1 

s=s+x < i j ) 

IF(NKN.E0.NN)GG  TO  27 
25  CONTINUE 
27  XXsS/NNN 

PRINT  20. XX 

IP1=I*1 

T 1 P 1 = T ( IP1  > 

2A  K*X«1 

IF(K.GT.N1  I GO  TO  7f 
TSK*T3<K) 

IF! TSk.oc.TIP1 )GO  TO  2C 
M s M + 1 . 

E=XX-X j(N | 

SE=3E+E 
SE  2 = S5 

SAE-SAF  4Ao3!  E I 
E 3 = S fc  / M 
AEti=SAE/M 

IT  (M.iiT  .1  . )GC  TO  SO 
SIG^O. 

GO  TO  ->C 

»c  A« ( SU2-< SE»SC/«  I) / (M-l  . ) 

s i g;=surt 1 a ) 

SICi!;u*SIGL/S<JPT<  FLOAT  Ir.NN  1 ) 

RVSE  = SOR  T<  .J  I uE*c  I GF  ♦(  u«  Oil  » 

R M >:" d = SORT  < S 1 ,r  i)  * 3 1 Gc  il*  c ti  »C! d I 

Of  LT  = R VSEH-GRRSFL' 

SR'13E*SOt-T  I . ’♦PELT7PFLT/94.  •1*SMM5.-*SPMSE  | 

SRMSct>=  •2*RMS£e4.d*SRMSFU 

PRINT  2C .XX.tJ.SIGc . S 1 GL J . AO  d , RMS 5 • RMSStj • SRMSErt. 3 RMj C 
GO  TO  2* 

C CONTINUE 

7 C CONTINUE 
RETURN 

r no 


H-6 


C 


THIS  PAGE  IS  BUST  QUALITY  PRACTICABLE 
FROM  COPY  FURNISHED  TO  GDC  


) 


i 


SOHRC1UT  I tit  OSTES 

COMMON  /«/  ni.tieccci  .xmceoi.Tsiitcooi  .xs(2CCi» 

REAL  m 

KL'AJU  * 1 C ) N i I r .1  1 . Ki  .TUtL.TX.UELC  .XXC  .EM  A ,Et« 
i C ralirA  AT  ( a I 3 . Ijr'7  .2  ) 

PRINT  lJ.N.IC.ll.M.TOEL.TX  » DEL  C • XXO  . tMX  , P<N 
c READ!  l>2C)(T(I  > . I * l .N ) 

C RtAUl 1 ,2C  > 1 X 1 I > , 1 = 1 .N ) 

C RLAOl  1 .2C  > ( TS<  1 > . I =1  .M 

C.  RFAOl  1 ,CC  I ( XS(  I 1 . 1=1  iN) 

2 C FORMAT ( 1 CF7. 2 I 

M = C • 

ss=c . 

!iL2  = C. 

SA6  = C . 

DEL  =DELC 

XX=XXC 

T13*T(I”) 

SR.MS  = <3=2. 

SRMSE*:  . 

K = C 

0 K * K F 1 

1F<TS(K).LT.TIC IGO  to  3 
00  3 C 1=10.11 

IF  1 M*.LS  . 1 . >GC  TC  35 
FNL  = < SI<iE/XX/E«X)**2-l 
IF1KNC.LT. 1 IFNL»2 
FNU  = ( SIGS/XX/EMM  =*2-l 
IF (FNU.LT.l )KNO=2 
PRINT  22  .FNL.PNU 
35  111=1-1 

FN1 =TOEL/DcL 

IF ( *.L£. 1 . KiC  TO  37 

Ififni .lt.fnl)kni=fnl 

IF  (FNl  ,uT  .FNO  >FN1  =f  NO 
37  ADEL  = 2./1FN1F1  , » 

OLL  = ADEL* 1 T 1 I I -T(  I 1 1 I-OEL )*0EL 
F N2  *T  X/DEL 
1F1M.LE.1 . ) GO  TC  29 
IF  1FN2.LT.TNL )FR2=FNL 
IF! FN2 .GT .FNO  »FN2  = FNO 
39  AX  = 2./IKN2f1  . ) 

XX-AXAt  XI  l )- XX ) FXX 

PRINT  22  .FNl  .ADEL.FN2.AX .XX 

IP|=I FI 

TJP1*T1 IP1 ) 

2A  XXNFl 

IF  IK  .CT  »N  1 )GJ  TO  70 
IF! TS1K1 ,GT . T IP!  1GC  TO  30 
M = M ♦ 1 . 

E=XX-XS1K ) 

Sf  »5F*!i 
Se2  = SF.2  FE  *E 
SAF.«SAEFA13S1  E I 

En=sS/M 
AC.1»3AL /’* 

IF1M.0T.1.IGC  TO  30 

SIGL=C . 

GO  TO  oC 

SC  A = 1 SE2-1  Se*S“/M)  I/1M-1  . > 

S I GE  * SQR  T l A ) 

60  Slut  J = 310=./SC^T1F|\?) 

WM5E  = SvJPT  I S I bE  *S  I GC  F&H  = eu  > 

R'tSEd  = jvjr  T I 3 |ur.  m f *j  J CE f ♦ C ct  * E it  1 
UELTxRMSSH-jRMSSU 

SRMSLaS  JkT  | ,2*U;LT*i:ELT/->F.i<«SRMSc*iRF.SE  I 

Sr. --rjC  0= . 2 m se  u f . « • sc  ms a 

PRINT  2C  • XX  , L-i.  S I GE.  S I tifct!.  AEU.  RMS2  . RMScJ.  SRMS*-d.  SRMtiE 
GO  TO  24 
33  CONTINUE 

TC  CONTINUE 

RETURN 
END 
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THIS  PAGE  IS  BEST  QUALITY  PRACTICABLE 
tfROM  COPY  PUKNISHM)  TO  ADC  — 


SUdl«OUTtf;S  CSTUCS 

cci-'jcn  /h/  m . t< 2000 1 ,xi rceo 1 , ts< 2000 ) ,xs(2oc o i 

AC  Al.  A 

REAL.  ( 1 , 10  IN  . K . IS  ,M  , SAC  . 6 5XC  . Ebu  ' . At  DC  . AC  . A1  ,F 
10  FORMAT!  41  3. 7f  7. 3) 

PRINT  1C  >Mi  1 C . II  ,N1  , SXO  ,a3XC.EbUC.AcdC, AC. Al.F 
READ!  1 ,20  ) < T(  I J , | =1  ,N) 

RE AO< 1 ,2C  > ( X<  I ) . I si ,N> 

Rfc ADI  1 ,20  > ( TS ( I ) . 1 = 1 ,N ) 

READ!  1 ,?C  » ( XSI  I ) , 1 = 1 ,.N  I 
20  FCRM AT l 1CF7 .2 ) 

M = C . 

s £=;. 

Sc 2=0  . 

SAE=C. 

TJC  = T(  IC  ) 

SRMSS8=C. 

SPMStisj, 

K = 0 

S K =K  » 1 

IF  1 TSIK) .LT.T  10 ) GO  TO  5 
KK  = 0 

DO  3C  I - I C . I 1 
^ x 1 

IF  M.GT.O.  >GC  TO  37 

sx=sxc 

ssx=ssxc 

eau=Edbo 

AEe=AEU0 

31  TSS  = AriSI CbU/AEd  ) 

IF ( TSS.LT .AC >GO  TO  32 
I F ( TS5.GT.A1 ICO  TO  3* 

ALF=TS3 
GO  TO  36 

32  ALF  = A C 
GO  TO  36 

34  ALF  = M 

36  IFIKK.GT.C1G0  TO  30 
F.K=1 

3 7 tbo  = ALF  *<  SX-X  I I ) ) ♦ I 1 .- ALF  >»Eae 

AEB=ALF*AOSl SX-X(I))f(1.-ALF)*AED 
GO  TO  31 

38  S X= ALF  * ( X ( I 1-SXIfSX 
SSXL=S3X 

SSX=ALF* ( SX-SSX  ) + SSX 
XX=5X+F»(iX-SSXL) 

PRINT  2C .F.ALF.TSS.XX 
IPI =1 +1 
TIPI =T ( IPl » 

24  K = K*  1 

IFIK.GT.N1  ISO  TO  70 
IF ( TS( K ) .GE.T IPl )GC  TO  37 
M = M2l • 

E = XX-XS( K ) 

SE  = 5F«-E 
SC2=S'22*E*r 
S AF;  = S Ac  ♦APS  ( E) 

ED=S3/M 
AE JO=SAC/M 
IHN3T.1.IGC  TO  SC 
SIaF=0. 

GO  TO  6 C 

00  A=(  SE2-1  SS*SE/M) I /CM-1 . I 

SIGC«S'1WTI  A > 

60  SlGCe*»SIGE/SCRT(  I2./AL F 

RMSF  = SORT ( S lC2»SIGE*tH*Lo  > 

XMSl  d=3GRT  1 S IGF i* *5  I CEtt4Lii*Ed  > 

D£LT=RM3tU-3RMSCd 

SRMCF.»SONT(  . 2 * CCL  T *OELTZ  > ♦ . A • SR. MSI  * JWV.  S = ) 

OR  M5EU  = .2«RMS,'  Ot  . C*SRMSCd 

PRINT  20.  XX  . fu  . s ICE  .S  IGF  U.  A_l)M,OMSE  , RMSEd.  S^MSCd.  SR  A Sh 
GC  TO  24 
3C  CUNT  I NUT 

70  CCNTINUt 

!’t  TiiRN 
END 

I 


H-8 


XHIS  PAQE  IS  BBS!  QUALITY  PRACTICABlI 
FROM  OOiPy  FURNISHED  TO  DDC 


C. 


C 


C 


C 


ic 


c 

c 

c 

c 


2C 


AC 


24 


1C 

•SO 


3*5 


SUJRUUTINE  0£TH 

Cu'JNUN  /cl/  Nit  T ( 2 C C C ) . X ( 2 0 C C ) 


HEAL  m 

HE  AO  (1  tic  ) N . 1 : • 1 1 t NN  t N 1 
FORMAT! 513 t 7 F 7 • 2 ) 


PH  I NT  1 : |N . I 
RE AO ( 1 t2C  > C T ( I 
HF AO ( 1 ,2  ' ) < X t 1 
re aoc i it : ) l TS( 
re  ao  < i . i ; ) ( xs( 

FORMAT! ICF7.21 
M-C  t 


; 1 . NN.Nl 
I t I x l • N ) 

I tl-ltN) 
t ) t 1=1 tNI 

[ ) .1  = 1 .M 


SE=C. 

SE2  = C . 
SAEXC. 

T I C = T ( I C ) 

srmseu*: . 


SRMSE=' . 
S5RMsexC . 
SSS-MSE=C. 


K*C 
K = KEl 
TSK=TS(K) 

IF ( TSK ,LT .T I 3 )GC  TO  5 
00  3C  1=10.11 

K = K-  1 

A*C  • 


T S ( ’COO ) . XS( EC ZC) 


0 = C • 

0 = 1. 

C = E. 

F=C. 

DO  AC  J=l .NN 
1 J= I - J+ 1 
X I J = X < I J ) 

v»=  1 . 

»=»♦ A*I J*IJ 
[3  = H4W*  1 J 
0=0  + W 

E=E*W*XI J*I J 
F=F*W*X1 J 
OEN= A*0-b*U 
AA= (0*E-b*F l/CEN 
UB=I  A*F-B*c>/OEN 
XX  = AA«i  I +1  1 ♦ tit! 

IPl*l«-l 
T I P l = T I I P 1 > 

K=KU 

IFIK.GT.N1 )30  TO  7C 
TSK*TS!  < I 

IFIT3K.GE.T1P1 1GJ  TO  3C 

M*M-M  . 

E=XX-XS( < 1 
se*se+f 
SE2=S22  *=*0 
SAfc«SAE«-AtlS!C) 


eu=SE/M 

Acr)=SAF/M 

IFIM.oT.l.  )<JC  TO  5C 
SIGE»'. 

GO  TO  vO 

AAA=(:;,*2-(3E*3C/M)  »/(m-1.) 

S!GE=S  1RT1 AAA) 

S I GF.O=  3 1 GE  /SCR  T ( FLOAT  ( NN  *11) 

RMSr;  = S0RT(  jlGi*Slofc+Lb»Eo) 

SSG.NMS'JsGORT  ( .2  * ( RMSE-  3SRM3F  ) #h*SSSRMSI- *SSSR  MSC  ) 

SSfiMSE* ■ 2 4PM S F ♦ • 1 * S 3 R M £E 
RMSF.E*S.)RT(  5 IG£e*3  l OF  o*GB*E!3  ) 

OELTxR MSEB-SAMiEU 

Sr...(3£s30WT(  .«*l)CLT»uCLT/v*.'J*SRMSL*iMMSF  ) 

SRMSEd=..’»<M3Ee«-.e*SPPSEU 

r»o?  * XX  * to  * 5 1 • APP  • RMS  *.  • 53RM5E  • S3  SR  4 3E  • RAH  Sl  M , 

PRINT  2" . SRMSt 
GO  TO  2* 

COAT  I NO  -' 

CONT l NOE 
RETURN 
LNO 


t 
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THIS  PAGE  IS  BEST  QUALITY  PRACTICABLE 
EBOU  COPY  FURNISHED  TO  DDC  


SUBROUTINE  C S TNP 

COMMON  /b/  Nl  , TI20CC)  .X(2CCC  ) . TSI200C  I .XS1200C  » 
PtAL  M 

BE  AO ( 1 i 1 C IN . AN .MJO .M  >007.00  I 
1C  FUHMAT ( 4 I 3, 7F7. 2 ) 

PRINT  lC.N.NN.NUU.M .UOT.UDl 

c «cad( i • jc i ( tc i > , i s; ,ni 

c FFAOI  1 •«>?)(  XI  t >•  i»:  *N) 

C READ!  1 .L?  I < TS(  I ) . 1-1  >NI 

C BcAOl  1 ,2C l(  Xs<  I I . 1 = 1 >N) 

2C  FORMAT ( 1 CF7.2 I 
Mai. 

sc»c . 

S r.  2 M Z • 

SAjsC. 

T T*U0 T*NOU*O0  I 
K«C 
KK  *C 
UT*UOT 
7 KsKM 

T SK  = T S ( K I 

tF(  TSA.LT.UT  ICO  TO  7 
K*K-  1 

5 KK>KK»1 

IF (KK .GT.NIGO  TC  7C 
T K<a T ( KK  ) 

IF< TKK.LE.UT  ICO  TO  3 
KK 1 »KK- I 
NNN  = C 
S = C • 

00  13  J=1,KK! 

KK J-KK- J 
NNN=NNNF 1 
S*SFX ( KK J I 
IF( J.eu.KNICO  TC  17 
15  CO  >T  INUU' 

17  XX*3/NNN 

PRINT  1C .NNN.K.KKl ,X* 

UT  *UTFUU I 

IF(UT  ,CT ,TT ICC  TC  7C 
2 A K * K F 1 

|F(K.GT.M  ICO  TC  7 C 
TSK»TS(K! 

IF ( TSK.LE .UT ICO  TO  35 
K»K-  J 
GU  Til  3 
35  MaMtl . 

t«KK-XS(KI 
St  = 5EF=. 

SE2»5t2*t*E 
SAE"5AC*ABS( E I 
EbabtVM 
ACHa SAC/M 

IF  ( M .CT . 1 . IGC  TO  5C 
SIGE«r . 

CO  TO  iC 

5C  A=(SE2-(  SG*SF/m)  1 / ( '.I  - . | 

S1C5*S0PT  < A I 

••V  S I CfiLia  i I CL  /SCTTir  LOATC  NNM  I I 

KM  St  «S0."<  T ( S I CC  »S  ICL  *F  J*  - ! I 
P«seH*EOBT( 3ICCd*SI CEufE  u «E n | 

BC  *mmse/XK 
RIiS»PMSru/XX 

PRINT  iC  . M,  XX.  Eb.  5 ICE  . S IGF.  B . AEU.KMS2.  N.M  3C&  t Hi  ,i7EU 
GL  TJ  24 
30  LCNTI.NUF. 

TC  CONTINUE 
RETURN 

end 
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QUAim  practicabu 

FROM  COPY  FURHISH£D  TO  DOC 


cu  i.tc.uti  n?  ciT.-p 

/ >/  m . T(  joe: » .a ( ?:o : ) . T3(  :oc  ) , xs< 2 :ao» 

r*1  al  ’■» 

(Ji  Aj(  I 1 l'~  I I|NU‘.|M1  iTC'-LtlX.  ItLC.KXC  .i:vU.CMN,Oi)r  ,JJ1 

:o  r Li.<  ur  ( 2 1 j , "f  ? ) 

I'.fl’lT  1 C .N  , NLU  ,M  . TOFL  . TX  .OcL.'  , XXC  • KMX  , 2MN.  UUT,  UO  1 
c ReAOl 1 ,20  )( T(  I ) , la:  ,N) 

r.  KF.AOl  I ,LC  ) ( X(  I ) , I =1  ,N) 

f re  *o<  t ,zr  it  Tit  it . 1=1  in) 

c '.LAOl  1 .£C  M X J ( I ) • 1 -1  .N  I 

20  FORMAT!  ice  7.2) 

M “ C . 

SE  = C . 

sJZ-1: . 

SAP " 0 • 

i t*uot»  muo  *uo  1 
K»C 

OT  * UUT 
7 K=K+1 

T5K=TS( < » 

It-  ( T5X.LT  . UT  1 GO  TO  7 
K*K-  1 

5 KX»KK*l 
Tkk*t (k<  ) 

IF! TKA.LE.UT 1GG  TC  5 

KK 1 *KK-1 

OtL*OEL; 

xx*xxc 
xnasaac 
FNL*TX/OCL 
13  UT  = UT  *UO  I 

IF t UT .GT .TT ICC  TO  70 
’*  K=AM 

IF1K.GT.NI  >GO  TC  7 c 
IF1T51KI .Lt  » L T | GO  TC  35 
K = K-1 

16  IF  ( T ( KN  > .GT  .UT  IGO  TC  1 
1F1M.LT. 1.1  GO  TJ  17 
FNL=15lwE/XX/tMX)«*2-i 
IFtFNL.LT.l . IfNL*? • 

FNU=(  3IGE/XX/e-iM»*2-t 
IF1FNL.LT.1  . )FNL-*2. 

MH|')T  2C  , FnL  , FNU 

17  FN1»T0CL/0EL 

IF ( M.Lt . I . IGO  TC  37 
1F1FN1.LT.FNL  |FN’  *FNL 
IF1  FN1  . GT.FNU  JFM  *F,SU 
37  AIJCL^a./ 1 FN1  ♦ 1 . I 

ULL’  \Oc.L«  1 r 1 AK.  ) -T  1 AK1  )-»lL  ) *OEL 

FN2=TX/OLL 

IF  1 V ,Ll. : . ) .0  rC  3 ) 

IF1FN2.LT .FNL )FN2*FNL 
IF  1 F A? .GT  .F  .U  )FN?*F\u 
30  AX*2 . / 1 FN2* I . I 

xxxsax«ix(x.k)-xxx|fxxx 

I’R  I M T ?C  ,F.N1  . AC  cl-  . FN2  . AX  , XXX 
KKaKK+1 
KK1 = KKl f 1 
GO  TU  It 
1 A XXsXXX 

GO  TO  13 
3 S M = A ♦ 1 . 

EaXX-xSIK) 

SL*iL»L 

sc<;»r.t?+e.  *e 

SAf»$AL*Ai3Sl  El 

Ert«sr/M 

ACUaSAi/M 

IF  1 m.cT .1 . IGC  TO  50 

SlGf.*C  . 

GU  TO  65 

‘T  Ax  ( iE2-  1 SF*IVE/ » ) )/  1 M-l  . ) 

S I GO  " SuF  T I A ) 

at3  SI  ,rli«SIG'/3c  ITlt  NLI 

OMS: :«SOi-T(  5IGF«>0IGi*Eu*r  ill 
F'M6Ctx50f»TISICFu»SIGttl*':  rfxc.l) 

Riixowsr/xx 

G3  print  ..5  .M.XX.FJ.SIGL.S  I G IS  . ACM  , RMSE . F M ifrt . R5  .ft  «U 

‘*0  T | 2^ 

* - continue 

'C  CONTINU- 
AL TURN 

LN.I  H-ll 


C 


rronnrinr. 
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IBIS  PAGE  IS  BEST  QUALITY  PBACTICABU 
PROM  COPY  FURNISHED  TO  DDC 


SU-JB  OUT  I NE  SOB TAG  ( A , II  , J J . T AG  > 

SORTS  A 1 • Av  A 1 N T,  I I CREASING  OTOCR  ► UV4  A ( II)  TO  A(JJI 
ANEAV  TAG  ( S PERMUTEC  TEE  SAME  AS  A F F AY  A 

OWUFR ING  IS  LT  IMrfu.  < -iUilT  ••'ACT  ION  . Ti-tus  FLOATING  POINT 
KUMOEHS  MUST  iJ  E IN  NCSF4L I2tO  FORM. 

ARRAYS  I U ( K > AND  I L I K | PERMIT  SJWTINo  UP  TO  2**<i<*1)-1  ELEMENTS 
CUC  6400  TIME  IS  3.26  SEC.  FOP  1CCCC  RANDOM  ITEMS. 

AND  JTHSXWISF  PRGPCRT ICNAL  TC  N*LCG(N> 

R.  SINGLETON,  SEPTEMBER  IS6d 
DIMENSION  A ( ! ) , lu<  1 6 ) . IL  < 1 <»  ) . TAG  ( 1 ) 

INTEGER  A.T.TT 
•',=  1 
I = I I 
J- J J 

5 I F ( I .CE.  J)  GO  TO  7C 
1C  K=  I 

I J = < J + I 1/2 
T = A ( I J ) 

1 F l A ( I)  .LE.  T ) GO  TO  20 
A ( I J ) = A I I ) 

AID-T 
T=A( I J) 

TG  = T AG(  I J ) 

TAG!  I J)-TAC<  I ) 

TAG! I ) - TG 
c C L = J 

IFIA(J)  .GE.  T)  GO  TO  40 
A ( I J 1 = A < J ) 

A( J)=T 
T = A < I .1  ) 

TG=TAG(IJ) 

T A G ( 1 J ) =TAG( J » 

T Au{ J > = TG 

I F ( A < I ) . Lt . T ) GO  TO  4C 

A ( I J » = A ( l ) 

A ( I ) a T 
T=A< I J ) 

TG=TAG< I J ) 

T AG(  I J >=TAG<  I ) 

TAG(  I ) = T G 
GO  TO  AC 
30  AILl=A(Kl 
AlKIaTT 
TG=TAG(L  > 

TAGIL ) = T AG< K ) 

TAGIK )=TG 
40  L=L-t 

IFIA(L)  .GT.  T)  GO  TO  4C 
TT=A(L) 

SC  * = K*l 

I F { A ( K ) .LT.  T)  GO  TO  50 
I F ( K .LE . L)  GO  TO  2C 
IFIL-I  .LE.  J-K)  GO  TO  60 
ILC1  ) = I 
tU  ( M ) =L 


oC 


ao 

»c 


i c • 


1=K 
M = M*I 
GO  TO  HC 
ILl MI=K 
IU(M)=J 
J=L 
M = M + ! 

SO  TG  no 
MsM-  I 

II(M  .EG.  C>  fie  TURN 
I=IL(M) 

J- 10 ( M ) 

IMJ-I  ,GE.  11)  GO  TO  1C 
I F ( 1 .50.  I l ) GO  TO  -3 

1 = 1-1 
1 = 1*1 

IF(  I .fc.J.  J)  GO  TO  7C 
T=A< 1*1) 

I F < A ( I ) .LE.  T)  GO  TO  9C 
TG=TAG( 1*1) 

K*  I 

A(K»1  J.-AlKl 
T A S ( < ♦ ) I * T AG ( K ) 

K = K-2 

IF  I T ,lT,  A ( K > I GO  TO  IOC 
\ < K ♦ l ) = r 
TAG! ft  * I I x TG 

GO  T I)  »C 


a NO 
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